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PREFACE 


This is the final report of the research project "Optimization of Life 
Support Systems and Their Systems Reliability (NASA Grant No. NGR 17-001-034)' 
The project was initiated on June 1, 1968 and terminated on May 31, 1971. 

Since a majority of significant results from the project have been pub- 
lished, no attempt is made to give an exhaustive account of the project. 
Instead, a brief summary is provided here and readers are referred to copies 
of papers and reports which are appended for details. 


SUMMARY 


The identification, analysis, and optimization of life support systems 
and subsystems have been investigated. For each system or subsystem that 
has been considered, the procedure involves the establishment of a set of 
system equations (or mathematical model) based on theory and experimental 
evidences; the analysis and simulation of the model; the optimization of the 
operation, control, and reliability; analysis of sensitivity of the system 
based on the model; and, if possible, experimental verification of the theo- 
retical and computational results. 

The work so far has evolved into several distinct activities and the 
results of these activities have been published extensively. The research 
activities include: 

(a) modeling of air flow in a confined space - a study in age 
distribution, 

(b) review of several different gas-liquid contactors utilizing 
centrifugal force, 

(c) review of carbon dioxide reduction contactors in space vehicles 
and other enclosed structures, 

(d) application of modem optimal control theory to environmental 
control of confined spaces, 

(e) optimal control of class of nonlinear diffusional distributed 
parameter systems, 

(f) optimization of system reliability of life support systems and 
sub- systems, 

(g) modeling, simulation and optimal control of the human thermal 
system, 

(It) analysis and optimization of the water-vapor electrolysis cell. 

These works are summarized and presented in this final report. 
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Air Flow Models in a Confined Space 
A Study in Age Distribution 

MICHAEL S. K. CHEN* 

L. T. FAN* 

C. L. HWANG* 

E. S. LEE* 

It has been shown that a fairly general model for the distribution of air in a 
confined space can be established based on the concept of the age distribution. 
The use of such a model in design , data correlation, control , and scale-up 
problems is discussed and the experimental determination o) the model is out- 
lined. It is indicated that some of the parameters of the model can be estimated 
based on a simple entrainment concept. Results of simulation of the model on 
digital computer are presented in detail. 


INTRODUCTION 

A PROPER air distribution is essential in air heat- 
ing, ventilating, and air-conditioning systems. Even 
though a system delivers the required quality and 
quantity of conditioned air (or oxygen) to a con- 
fined space such as a room or a space craft or an 
underground shelter, unsatisfactory conditions 
result if the air is poorly distributed and improperly 
circulated. The mechanism of air flow and distri- 
bution in a confined space is very complicated. 
Although, theoretically speaking, the Navier- 
Stokes equation can be used to represent air flow 
and distribution in such a system, it is extremely 
difficult, if not impossible, to solve it exactly. Thus, 
engineers are often compelled to seek approximate 
solutions based on simplified assumptions. 

In this paper, the concept of age distribution will 
be used to study the air distribution in a confined 
space. This concept has been used successfully in 
the study of mixing in chemical reactors[4, 5]. A 
fairly general flow model which encompasses several 
specific flow models based on this concept are 
proposed. The use of these models in design, data 
correlation, control, and scale-up problems is dis- 
cussed. Experimental procedures for verifying the 
proposed models and predicting the various para- 
meters in the models are also discussed. 

The use of the concept of age distribution in the 
study of mixing and flow in a confined space is 
especially useful for systems such as an under- 
ground shelter, a space craft, and a submarine, 
where the purity of air is important. Knowing the 
age distribution of the contaminated air, the 
optimum way to purify this air for undesirable com- 
ponents may be determined. Furthermore, the im- 
pulse response study discussed in this paper should 
be a useftil tool for studying tbs dynamic behavior 
ofair in a confined space. 
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SPACE AIR DISTRIBUTIONS AND AGE 
DISTRIBUTIONS IN A ROOM 

A qualitative description of various types of space 
air distributions is presented in reference! I ]. It is 
based on the results of performance tests of various 
types of the air outlets at the University of Illinois 
[2. 3]. Different space air distributions for the follow- 
ing five groups of outlets are discussed in refer- 
ence! I ]. 

(1) Group A. Outlets mounted in or near the 
ceiling and discharging the air horizontally. 

(2) Group B. Outlets mounted in or near the 
floor and discharging the air vertically in a 
non-spreading jet, 

(3) Group C. Outlets mounted in or near the 
floor and discharging the air vertically in a 
vertical spreading jet, 

(4) Group D. Outlets mounted in or near the 
floor and discharging the air horizontally, 

(5) Group £. Outlets mounted in or near the 
ceiling and projecting the primary air vertically. 

It has been noted that the space air distributions 
also depend on whether the discharging air is used 
for heating or cooling. By examining these distri- 
butions it has been shown(l] that we can roughly 
divide the air space into the following zones. 

(1) The primary air zone. This is the part of the 
space from the outlet down to where air 
velocity becomes anproximately 190 ft/min. 

(2) The total air zone. This is the space com- 
prising the air discharged from the primary 
air zone and the entrained air from the 
general room air motion zone (descri b ed 
below in 4). The air velocity in this gone is 
still high as it is influenced by the primary air, 
hot less than ISO ft/min. The air temperature 
is generally within 1'F of the room tem- 
perature. 
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(3) The stagnant zone (or dead space). This is 
the space where the air velocities are usually 
low, I $-20 ft/min. It exchanges mass and heat 
with other zones mainly by natural con* 
vection, 

(4) The general room air motion zone. This is the 
part of space in which there is a gentle drift 
toward the total air zone (i.e. entrainment). 
Air motion in this space is attributed to the 
recycle stream of total air. 

As an example, let us take the space air distribu- 
tion of Group A which is shown schematically in 
figure I. The side view is shown in figure 2, where 
A denotes the space of volume V A comprised of the 
primary air and total air zones and B denotes the 



Fit. I. Typical airflow pattern in a room. 


space of volume V B corresponding to the general 
room air motion zone. Below zone B is the stagnant 
zone. This picture can be represented by a flow 
model which is schematically shown in figure 3. In 
this flow model, r is the volumetric flow-rate of dis- 
charged fresh air and intake air under steady-state 
condition, fit is the recycle flow rate and V d is the 
volume of the stagnant zone which exchanges mass 
and heat with V B by natural convective currents. 
The dotted arrows between V A and V B indicate re- 
circulation streams between these two zones. To 
simplify the discussion, these recirculation streams 
will be omitted and V t will be taken as zero in the 
present treatment. 

Each air fluid element upon entering the outlet 
of duct (or jet) will spend some time in the room 
before leaving. It is obvious that the exit time of one 




Fig. 3 . The schematic diagram of a flow model. 


element is different from that of another not only 
because of the circulation of air stream in the room 
but because of the internal mixing (due to the tur- 
bulence and velocity profile effect, etc.) in each 
zone. T -refore, there is an exit age distribution in 
the leaving air stream. This exit age distribution will 
be denoted by £(r). £(/)dr represents the fraction of 
the fluid elements in the exit stream having spent 
the time between t to r + df in the room, and 

|f(0df ■ 1. (1) 


It should be noted that E(t ) is completely deter- 
mined by the space air distribution and the mixing 
characteristics within the space. On the other hand 
if we know E(t) from experimental measurements 
(e.g. by tracer techniques to be discussed later), a 
flow model characterizing the space air distribution 
can be established. Note that there may be several 
possible models which may give rise to the same 
exit age distribution E(t). However, we can often 
choose the best by knowing the geometrical, fluid- 
mechanical, and other physical and chemical charac- 
teristics of the system. 

Intimately related to the exit age distribution, 
£(f), is the internal age distribution, /(r), which 
accounts for the distributions of the ages (the lengths 
of time elapsed since the entrance into the room) of 
fluid air elements at any moment in the room; 
I(t)At represents the fraction of air with internal 
age between t and r + dr. We can see that 


j/(0*-l. (2) 

There is a unique relationship between the two age 
distributions £(f)and I(r). It has been shown that[4] 


m 


t m 

d t 


where 



mean time. 


( 3 ) 

( 4 ) 
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It has also been shown [4] that the mean exit age 
defined by 

? £ = |/£(0d/ (5) 

is equal to mean holding time l for the enclosed 
system, i.e. 

V 

! = }[=-. ( 6 ) 

r 

Note that this relationship has been shown to hold 
only for the enclosed systems. When movement 
into or out of the system can take place in ways 
other than by bulk flow (e.g. diffusion boundary), 

l * h- 

These two age distributions, namely, the exit age 
distribution and the internal age distribution, to- 
gether with their derived properties such as vari- 
ances and skewness have been used successfully in 
characterizing and designing the nonideal flow 
system in process industries. It is the purpose of this 
paper to explore their applications to the analysis 
and design of an air distribution in the enclosed 
system. 

In the following sections, we shall first derive 
some useful representations of age distributions 
based on the flow models such as those shown in 
figures 1-3. Then the determination or prediction of 
the various parameters in the models will be dis- 
cussed. Experiments which can be used for this 
prediction will also be proposed. 

DERIVATION OF EXIT AGE 
DISTRIBUTIONS 

In this section, several basic building blocks of 
flow models will be discussed. They will then be 
used to obtain age distributions proposed in 
figurr ?. 

As discussed earlier, different internal (back) 
mixing conditions exist in different zones of the 
space air. To characterize such mixing along the 
general flow direction, two models, namely, the dis- 
persion model and the completely mixed tanks in 
series model[5], are often used. The dispersion 
model is characterized by a diffusion type equation 
which it useful mainly to represent flow closer to 
the ideal cate of piston flow. The mixed tanks in 
series model is often used when flow closer to the 
other extreme case of completely mixed (backmix) 
flow (i.e. large mixing effect). The latter model 
appears to describe more closely the mixing in a 
confined space and will be used in this work. 

The completely stirred tank model (CSTJli) 

This it shown in figure 4. It assumes that each 
fluid element in the system has equal probability to 


leave the system no matter how long it has stayed 
in the system. Define 

Ad t * the probability of a fluid element leaving 
the system during the time interval 
(/, f+dr) where A is a constant, which is 
independent of time /, 

P(t) = the probability of a fluid element to be 
found in the system at time /. 



Fig. 4 . A completely stirred tank model ( CSTM ). 

Then the probability of a fluid element to be found 
in the system at time t + dr is equal to the probability 
of the fluid element found in the system at time t 
multiplied by the probability of staying in the system 
during the interval (t, t + dr), i.e. 


£(f+d/)« (t-AdO/V) 

(7) 

or 


P{t+dt)-PU) 

d< ■ - m) - 

(8) 

Equation (8) reduces to 


-II 

1 

1 

I 

(9) 

The initial condition is clearly 


| 

1 

(10) 


The solution of equations (9) and (10) is obtained as 

( 11 ) 

Let T be the random variable representing the exit 
age of each fluid element. Then the probability of 
T < r is equal to the probability ofthe fluid element 
has left the system at time t. This implies, from 
equation (I I), that 

Prob(f < ») ■ I-e _ ". (12) 

This equation holds for each fluid element at the 
exit of the system. Since the probability of the occur- 
rence of a certain event is interpreted at the relative 
frequency of the occurrence of that event, the 
probability of T < i is simply the flraction of fluid 
elements at the exit with age from 0 to Equation 
(12), therefore, can be written as 



l-t-*. 


<W> 



13b 


Michael S. K. Chen, L. T. Fan, C. L. Huang and E. S. Lee 


Differentiating equation (13) yields 

£(() = /.e' ; '. (14) 

From equations (5). (6), and ( 14). we can show that 

7 -£-p- 1151 

Therefore, the exit age distribution becomes 

£(/)=. -e' ,; . (16) 

i 


To obtain the exit age distribution for this model. 

let us define the random time T, . i = 1.2 n be 

the exit age of each fluid element at tank /. / = I. 

2 n. Each of this exit random time through 

each tank is independently and identically dis- 
tributed as given by equation (16). i.e.. 

£,(/) = re""'. i — i . 2 i; (18) 

L 

where 


It can be shown through equation (3) that l(t) has 
the same distribution as E(i). E(l ) or l{l) is plotted 
in figure 5. This distribution function is often called 
a decay function and is used in designing a ventila- 
tion system[6]. 



The Laplace transform of equation ( I ) gives the 
first order transfer function. 


E(s) 


I 

is+r 


(17) 


which has been used as the transfer function in con- 
nection with the automatic control of room tern- 
peraturc[7], where the time constant is simply the 
mear. holding time I. In actual space air distribution 
such as the one shown in figure I, the transfer 
function is not of the first order and the major time 
constant would be quite different from I. 


The n-CSTM In series model 
In case the mixing is less complete than the one 
CSTM, we can use the n-CSTM in series model with 
the fixed total volume to characterize the system as 
shown in figure 6. Volumes may be different or 
simply equal from tank to tank depending on how 
the mode of mixing changes along the flow. For 
simplicity we assume that the volumes of tanks are 
equal in this work. Then the number of tanks used 
represents the degree of mixing in the flow system. 


— l^J — h* 


Fig. h. The n-CSTM In series metM. 


i, = ' . / = 1.2 n. (19) 

n 

Combining equations (18) and (19) gives 

EM) = 1=1,2... (20) 

The overall exit age distribution can be derived as 
follows; 

the total exit random time T is 

t = t % +t 2 + . . . +r B . (2i) 

The characteristic function of T, and that of T are 
defined respectively as 

- 5 e iM ‘ H^Odi 

= E[t lmT ' J (22) 

and 

(M«) * ) e"' £(/)d/ = £[e‘" T ] 

- X 

where the second £ in each equation above is the 
expectation operator. 

From equations (20) and (22), it can be shown 
that(8] 

/« 1.2 n 

(23) 

and <M«) - £te" r ) 

» £[e MT| tT - + ■■ +r - ) J 
= £fe l,T, J £[c'“ T '] . . . £[e'“ T ”J 

- • • • *r>) 

since the expectation of the product of mutually 
independent variables, e" r ‘- e‘* r », e'“ r \ .... e M ‘, 
is equal to the product of their expectations, 

£{e‘* r, J, £le l,T, J .... £Ie ,,r “] 


or 

* r(») • l #T,(«)r* n 4 ) 

Substituting equation (23) into equation (24) yields 
+M « [1-lnd/n)]-. (23) 
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The density function of ^u) is well known[8] and 
is given by 


E(i) 


\i) 


(26) 


This is the desired exit age distribution of the 
ihCSTM in series model. It is more convenient to 
express it in dimensionless form by noting that 


I - j £(/)d/ = | t £(///) d(f/l) - j ?£(r/f)dO 

• • • 


- j EyO) dtf 

where 

m « ?£</) - <T e— (27) 

Equation (27) ; s plotted for various values of n in 
figure 7. For n* I, equation (26) reduces to 
equation (16) of the one (STM model. As we can 
see from figure 7, as n increases, the peak increases 



Fig. 7 . Dimnstoitieis exit mgt dutriituiom of the it~CSTM 
m series model. 


and this peak shifts to the right asymtotically to 
0 «■ I. This can be shown by differentiating equa- 
tion (26) and then setting the results equal to zero. 


This gives 

n— 1 

(28) 


n 

or 


- (v) • 

(29) 


The above infoimation is useful in evaluating the 
values of the oarameters and will be discussed later. 
Itcan be shewn that[5] 


mean: 9 « 1 (30) 

variance: r 1 --. (31) 

n 


Equation (31) indicates the significance of para- 
meter n in characterizing the degree of mixing for 
the system. If we substitute s for (-/u) in equation 
(2S). we obtain the transfer function for the 
n-CSTM system 


liS) i(i/a)s+ «r 


(32) 


Now, if we make use of this model to charac- 
terize the mixing both in zone A and zone B in the 
space air distribution describe'* in the preceding 
section (see figures I, 2. and 3), we can obtain the 
age distribution for the whole system. Let T be the 
random exit age of each fluid dement of the system. 
Then 

T- 7*, + r 2 + ... +r JM+ , (33) 


where A# is a random number representing the re- 
cycle passes with probability density function ptf*. 
When M — m, and m * 1, 2, . . , q is the probabil- 
ity of recycle for each pass and is equal to 
/lr/(l+/J)r = fil{l+P); while p is the probability 
of leaving and is equal to 1 -q » 1/(1 is the 

probability of each fluid element having m recycles 
before leaving the system so that / = 1, 3, 
S, . . . ,2A/+I is the time each element has to spend 
through zone A and r,.i = 2,4,..., 2 At is the 
time through zone B. By asing the method of the 
characteristic function[8], we obtain 


+j{u) = £{e Mr,+r,+ 

* £ M {£Ie , *‘ ri + r>+ +T >— i >| A#)}* 

«£*{(£le “*-)"♦ ' (E[t ,mTm ])"} 

-4-9 -('-in 

-■HTi 


p(\-iu[l A ln A ]) 


“•a 


i -(T- HUM) (1 


or 


(1— fwPa/ w iJ)~** 

(I +0-*l -iu 

(«) 



• £l.| Ml danotas tha 
wp[kA.T, + Ti+ ...+ Tt af<.|)| than that M 
tagm. fi»(.) 


of 

to any 


h- 


(l+0*> 


,1m 


y» 

& 
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and n A and n B are the values of the parameters of 
the models representing zones A and B respectively. 
The transfer function of it can be obtained by sub- 
stituting s for ( — hi) in equation (34). 


In the simulation of equation (36), the constraint 
as given by equations (37), (38), and (39) must be 
taken into consideration. Several specific examples 
arc presented below. 


(H-<P>aP~‘ 4 

W (I +01-00 +s[i A /n A ])-^ (I 

(35) 

The inverse transform or exit age distribution of 
equation (35) in general has no analytic expression, 
but we can often simulate it on an analog or a 
digital computer if we know the values of para- 
meters 0, n A , /i*, 1 A and i B . A typical exit age dis- 
tribution £(r) for the proposed flow model is shown 
in figure 8. 


SIMULATION 

It is often mote convenient to write equation (35) 
in the dimensionless form 

E(s) = 

0+s'lfi A /» A 1>-’* 

(1 +0)-0(l +s'lO A /n A ))-*(l +*W«»Jr"' 

(36) 

where 


s' = si 

0 A = hft 
0 • * ?•/*■ 

Note that these five parameters 0, n A ,n B , 0 A and 0 B 
are not all independent. They must satisfy the 
equations 

y- y A +y. 


« -s+-s 

» c 

- V+ffl A +PU 

, or 

l-(l+«9a+^.. (37) 

Besides, since (I, 0 A and 0 M am non-negative quan- 
tities, the following two natural constraints exist. 

oso+WaSi m 

OS /M, SI. (39) 


Case 1. «, = />' — 0 
Equation (36) reduces to 



and its inverse transform is equation (27) and is 
shown in figure 7. 

Case 2. n A = n B = 1 
Equation (36) reduces to 
r/ t >\ 1 +0 B s' 

V+IDOA0 t s ,2 H\+P){O A +O,)s'+i 

and the inverse can be obtained analytically as 

va—b _ . da—b .... 

E(0) -e r *+— — e * (42) 

C-fl « — c 

where 

1 

{l+W A 


0+/DM. 

(6xd-0.)-l-V{(ga+0,) 2 -40a9^(l + 0)) 

C 2 0 a 0 b 

(0 A +0 B )-V{(0 A +0 B ) l -40 A 6 B Hl +0)} 

20 a 0 , 

Figures 9 and 10 show the simulated results for 
case 2 with 0 and 0 A as parameters. 

Cose 3. »a“2,»*«1. 

The inverse transform for this case can also V 
obtained analytically. The expression can be found 
in any Laplace transform table. Figures 11 and 12 
show dimensionless aged distributions for 0 - 0-1 
and 1 with 0 A as the parameter. It should be ob- 
served from these curves that peaks exist and shift 
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away from the ordinate as 0 A increases. These 
indicate quite different characteristics from the 
preceding two cases where all curves exhibit a 
similar exponential type of decay as 0 increases. 


6 >'Tj3 


Y.\ A Porometer P 

A p 01 — 

-- 

0 8 \\\\ 0-10 0 

V\ 0’SOO 



Fig. 9. Dimensionless exit age distribution for n A * *• - 1. 
0 A = l/2(l+0), 0, = 1/20 with 0 as parameter. 


n, * 2. "b • 1 

/3 -i 

Poramelir Sj 

A ft, *0.05 
8 ft, *0 125 
C ft, *0 25 
0 ft, "0 375 


Fig. 1 2. Dimensionless exit age distribution for n A * 2, 
n, = 1, 0 = |, ft, = 1 -204 with ft, oj the parameter. 


Case 4. n A = n B - 2. 

Figure 13 shows the age distribution with 0 as 
parameter. It can be seen that as p increases, the 
peak not only shifts toward the origin, but the 
second peak starts to take shape. It can be shown 
that such a phenomenon of the existence of two 
peaks in the age distribution can occur only when 
both n A and n B are greater than 2. 


n A » n 0 * I 

9 d *1-2 9 A 

Poromtter 
d A *0 005 
ft *0 025 



Fig, 10. Dimensionless exit age distribution for 
n A -n,- 1, 0 - 1, ft. - 1 - 2ft, with ft, as the 
parameter . 


• 2 ♦ • i 

0 *01 

fti *10(1-1 1 ft*) 



PsrwMMr ft, 

A ft* *0.287 
• ft, *0.448 
C C ft* *0888 


<> 0* 04 04 04 10 I* 14 '4 14 1.0 

ft 

A. II, Dimentbakst exit age dbtribmt aa fi>r n A m 2, 
I, ft - Oil, ft* - 10(1-1 »4> with 9 A as the 


n A • n B *2 

A «-l 1— 

4 \*p 

®»*4 i 


Porom*ttf 0 


A 0*05 



Fig. 13. Dimensionless exit age distribution for 
«„ - ft. - 2, 0 - «!/(! + 0)1. 9. - Kl/0) w’/r* 0 « 

parameter. 

If « 4 and », go beyond 2, it will be extremely 
difficult to obtain analytically the inverse transform 
of equation (36). 

A numerical solution with the aid of a digital 
computer to simulate the flow model for (n A +nJ 
up to 36 will be discussed Equation (36) can be 
rduced to the form 

yf* {B+sT 1 

£(,,) " \+piA+sy'{B+sy-iiA-*r' 

„£1 {£±£1 ( 43) 

1+4 
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where 


A = 


1 1a 

0 A 



Since the denominator H(s') is a polynomial of s' 
with order ( n A + n B ), //(s') can be represented by 

H(s ) = (s'-r.Xs'-rj) . . . (i'-r„ + .,) (44) 

where r,, r 2 , ■ . . , r„ A +* B are its roots (complex in 
general). If these roots are all separated, the inverse 
transform of each root will be 


y*o) = 


A' A (B+r,r s 

1 +P n (r t -rj) 

i+i 


i = 1,2 (n A + n B ). 


(45) 


Furthermore, for a complex root r,, y^6) can be 
written as 


ym 


a' a (j+nr », 

l+P n ( r,-rj ) 

)* i 

(cos RIfi + j sin RIfl) (46) 


where RR, and RI, are the real part and the 
imaginary part of the complex root r, respectively. 


The exist age distribution is then 

m - m - ( 47 ) 

A computer flow chart for simulating the pro* 
posed flow model is shown in figures 14, 1 5, and 16. 
E(0) for the case n A «= 10 and n B = 5, is shown in 
figure 17. 


TRACER EXPERIMENTS, IMPULSE 
RESPONSE, AND THE DETERMINATION 
OF MODEL PARAMETERS 

Tracer experiments 

A small quantity of a gaseous tracer such as H 2 , 
C0 2 or Freon-12 can be injected impulsively at the 
inlet stream and the exit concentration of the tracer 
is monitored and recorded continuously at the air 
exit. This impulse response corresponds to the exit 
age distribution. The following factors can be 
systematically varied and parametrically studied. 

(a) Air (or gas) flow rate v through the system, 

(b) Size and shape (circular or slot etc.) of the 
nozzle or air jet, 

(c) Relative position of air discharge and intake 
of the system, 

(d) Internal pressure and temperature at various 
positions inside the system, 

(e) Volume and dimensions of the system. 



POLYRT it on IBM t subroutine for calculating the 
complex and real roots of o root polynomial 

Fig. 14. Computer flowchart of obtaining exit age dis- 
tribution E{9). 



Fig. 15. Computer flowchart of co mpa ri ng the co- 
efficients In llm polynomial HIS'). 
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At the initial stage of the investigation each para- 
meter should be observed independently by 
changing only one parameter at a time. However, 
effects of interactions among the various para- 
meters on the exit age distribution must then be 
studied to find the scale-up factors. 


CD 


Exit. 



Fig. 16. Computer flowchart of computing the inverse 
transform of each complex root . 


Determination of mode l parameters from response 
curves 

There are five apparent parameters of the model 
described by equation (35) in the preceding section; 
the recycle cotvstam /?, the mean residence times 
1 and and the mixing indices n A and n B . These 
parameters can be determined from tracer responses 
to impulse inputs such as the one shown in figure 8. 
It is seen that the time t c between two peaks or two 
valleys would be the mean recirculation time of 
each fluid element such that 

total volume V 

r = — . (48) 

* internal flow rate flv 

Note that the internal flow rate through zone A is 
(l+/?)r which is different from the internal flow 
rate through zone B ; flv. Since fl is in general much 
greater than 1, the overall internal flow rate is taken 
flv for simplicity. 

It was found[9] that in a cylindrical vessel having 
jet nozzles at the inlet and outlet respectively and 
filled with water, when the response curves were 
plotted in the dimensionless form, E(0) vs. 0 
(or f/0, they were remarkably similar to each other 
with various flow rates for a given nozzle size. 
These results indicate that for a given nozzle dia- 
meter, a flow pattern is established, which is 
essentially independent of flow rates. Hence it also 
implies that within the experimental range, the 



Fig. 17, Din muk u kit exit age totriLmkmfor n A - 10,*r 
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dimensionless circulation time 0 t = tji is in- 
dependent of flow rate and is only a function of 
nozzle size. It would be very important to see if the 
same property holds for the air flow system. We 
can test this b;' plotting t c vs. I jv for various nozzle 
diameters as shown in figure 18. If it turns out to be 


Nozzle diameter dj<d 2 <d 3 



Fig. 18. Circulation time versus inverse af now rate for 
various nozzle size , 


a straight line for a given nozzle size, then 6 C = tjl 
is independent of flow rate r. It follows from equa* 
tion (36) that 


Equation (37) is essentially saying that the recycle 
constant p can be found from the dimensionless 
circulation time B c , and is a function of the nozzle 
size only. This then establishes the method for the 
determination of the first parameter /J, the recycle 
constant. 

On the other hand, a good prediction of the 
recycle constant p is possible on the basis of a 
simple entrainment concept. It has been assumed 
that the recirculation flow in the room is entirely 
promoted by entrainment in the inlet jet. 

Equations for the entrainment of circular jets and 
of jets from long slots have been mathematically 
presented in ref.[l]. They are 

pv entrained flow 2 X 
P m v m initial flow * K' V^o 

(circular jets) (50) 

_ pv m entrained flow ^ // 2\ // 

^ " v m initial flow ~V vKyv\tfo/ 

(long slots) (51) 

where 

X - distance from faceof outlet, y 


Aq — effective area of the stream at discharge 
from an open end duct or at a contracted 
section. 

H 0 = w idth of slot, 

K' = proportional constant, approximately 7. 

For a given vessel the entrainment distance can 
roughly be assumed constant. Equations (38) and 
(39) require that ft is inversely proportional to the 
nozzle size. Experimental values of l//i. found from 
the dimensionless circulation time can be plotted 
against nozzle diameter d as shown in figure 19. 



Fig. 19. Influence of nozzle diameter on recycle constant. 


A circular jet has teen assumed. If it turns out to be 
a straight line, it will justify partially the use of the 
proposed model. Also from the slope of the line, 
one can estimate the actual distance the fluid 
elements travel. 

Once we have determined the recycle constant P , 
the other four parameters can be determined as 
follows. 

The height and the time of the first peak in 
the response curve are completely determined by 
the flow condition through zone A . Equation (29) 
can be written in the dimensionless form as 

where 



Equation (26) can also be written in a dimensionless 
form for zone A as 

( 33 ) 

For a given 0^ ami height of the first peak we can 
determine B A and n 4 uniquely by a trial-and>error 
procedure. M 
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Having established 0 A , 0 B is readily found sine *• 

0 C = 0 A + d B . (54) 

Note that 0 B is uniquely determined from 0 C and 
0 A , and 0 C is determined from equation (49). We 
may reduce the number of parameters from five to 
four. 

The last parameter n B can be found by trial-and- 
error until the simulated response of equation (35) 
matches the experimental one. 

DISCUSSION 

A flow model with four parameters is proposed to 
describe a typical space air distribution in a room. 
It is indicated that the exit age distribution E(t) or 
E(0) can be determined by using a impulse tracer 
experiment and various parameters of the model, ir. 
turn, can be determined from E(t). It is also shown 
that the model can be partially justified on the basis 
of a simple entrainment theory of air jets. 

This model is believed to be useful because the 
model parameters are closely related to physical 
quantities of the system. The recycle constant /? is 
the reciprocal of the dimensionless circulation time 


0 C . The mean residence times 0 A and 0 B of zone A 
and zone B respectively account for the mean time 
each fluid element must spend in zone A and zone B 
of the system. The mixing indices n A and n B are 
useful in understanding the mixing characteristics 
in both zones. These informations are directly help- 
ful in the design, data correlation, and scale-up 
of the system represented by the model. 

For the ventilation problem in a room equation 
(35) is a more realistic model than the decay func- 
tion^]. The same equation with some modification 
(with enthalpy balance including heat source and 
the location of temperature measuring element) can 
be used in the closed loop automatic control system 
of room temperature. 

The model proposed in this paper is only one of 
the many applications of flow models based on the 
concept of age distributions. The same approach 
can be intelligently employed for the study of other 
types of space air distributions. 
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Es ist gezeigt worden, dass ein ziemlich allgemeines Modell fflr die Luftverteilung in 
einem begrenzten Raum auf Grand der Auffassung fiber Altersverteilung festgelegt 
werden kann. Die Verwendung eines solchen Modells In Entwurfs-, Datcnwechscl- 
beziehungen-, Kontroll- und Bemessungs-problemen wird besprochen und die expert 
mentale Festlcgung eines solchen Modells wird umritsen. Es wird darauf hingewiesen, 
dass einige Parameter des Modells auf Grand einer einfachen Strdmungsauflassung 
geschfitzt werden kfinnen. Simulationsergebnisses des Modells aufDigitalrechnern 
werden in Einzelheiten dargelegt. 


II a did ddmontrd qu’un moddle assez gdndral de distribution d'air dans un espace 
restraint peut dtre dtabli sur la base du concept de la distribution d’age. L’utilisation 
d’un tel moddle en fonction de la conception, de la correlation des donndes, du 
contrMe et des proMdmes de la mise I Tdchdle est discutde et la determination ex- 
perimental du moddle est trade. II est indiqud que certains paramdtres de moddle 
peuvent dtre estimds sur la base d'une conception d’enchalnement simple. Let rdsultats 
de simulation du moddle sur un ordinateur numdrique sont donndt en ddtaJ. 
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Various types of contactors utilizing centrifugal force (centri- 
fugal contactors) have been used conmercially especially in the chem- 
ical industry for production of petro chemicals, organics, and pharaina- 
centicals, for refining petroleum, and for other purposes. The centrifugal 
contactors have been known to have characteristics of high efficiency, large 
gas and liquid through-put, small liquid holdup, and short contact 
time. 


Centrifugal contactors can be classified according to methods 
of utilizing the centrifugal force as follows (1): 
i) Tray type. In this type of contactor, kinetic energy of the gas 
from the lower tray is used to impart centrifugal motion to the liquid 
on the upper tray. 

li) Mechanically agitated type. In this type of contactor, gas or 
liquid in the contactor is mechanically agitated to Increase inter- 
facial area by atomizing dispersion of fluid, and to reduce resistance 
for mass transfer at the interface by disturbance Induced In both 
fluid phases. The column or tank with an agitator, and the apparatus 
with a rotating part have been Invented for this purpose, 
ill) Rotating type. This type of contactor consists of multistage 
concentric cylinders fixed to’ a rotating shaft. The gas and liquid 
in the contactor are brought into contact cocurrently or cross cur- 
rently. 

Since it is difficult to give a detailed description of all types 
of contactors utilising centrlfugsl force, emphasis will be placed 
on the description of the fluid dynamical and mass transfar aspects 
of scvoral specific types such as the rotational current tray. 
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the rotating concentric column, Piazza type contactor, Podobielniak 
contactor, and centrifugal contactor of the rotating type, investigated by 
the first author. These contactors are currently employed for industrial 
distillation, absorption, and humidification. It is expected that the 
centrifugal contactor of the rotating type which consists of all rotating 
parts will be applied in the near future to the life support of men in 
space crafts, air planes, submarines and civil defense shelters, and to 
prevention of air pollution because of its compactness and other advantages. 

It also appears that it can be used as a blood oxygenator. 

1. Tray types 

Various tray type systems in which mass transfer operations arc carried 
out have been developed and employed Industrially. In a plate column, when 
the gravitational force is the only force affecting phase separation, the 
vapor velocity and resulting liquid entrainment in the column may set the 
maximum allowable vapor velocity and liquid velocity. However, if the centri— 
fugal force is used to separate the entrainment, the capacity of such a tray 
may be increased. 

In the system constructed by Manning (2), the column wall is used as 
the outer cylinder of a cyclone, and the contacting of gas and liquid takes 

place on a small perforated tray section which receives liquid from the tray 

• * 

above and vapor from the tray below. The two-phase mixture is discharged 
tangentially into the settling zone. The liquid is forced outwsrd against the 
column wall by centrifugal force end flows Into the downcomer leading to the 
next lower tray. The vapor enters the tray above through a conduit located 
Inwardly from the column shall. It haa bean reported that the through-put 
of this tray Is larger than thoaa of many other traya (2). 


In contrast to Manning's tray, the Kittel tray (3) and the 
rotnt i cts.i! current tray (A, 5) are designed so that the flow of the 
ascend ! ; gas or vapor is directed almost horizontally across the 
tray iurf.uv through the openings. 

l:u; Kittel tray consists of a pair of upper and lower grids, 
and each c-'.o is divided into six equal basic parts. The openings 
in the tray are in the shape of slots inclined at an angle to the 
horizontal plane of the grids. Thus borne of the energy associated 
with the gas pressure drop is utilized to give centrifugal and cen- 
tripetal uotion to the liquid on the tray. That is, on the upper 
grid this notion is towards the wall of the column ana on the lower 
grid towards the center. Because of the absence of the overflow 
weir nrd downcomer area, the free cross-sectional area of the 
Kittel tray is more than that of the sieve tray. Detailed 

review of this tray has been reported (3). 

In the following paragraphs, emphasis will be placed on the 
description of the performance of the rotational current tray. The 
structure of the tray is shown in Figure 1. The shape of holes in the 

tray is a half ellipse, and it has a guide inclined at an angle to 

% 

the surface of the tray. As shown in the figure there are two types 
of the rotational current tray, the upper guide trey (U.G.T.) and the 
down guide tray (D.G.T.). The liquid on the tray is carried along by 
g v. .md is brought into Intimate contact with the gas. For this reason, 
t!.> t i.»y h.»:t uany advantages in comparison with other trays. 

In !*i gurus 2 and 3, the pressure drop of gas flow through a tray 
’ K'-W holdup on a tray of this type are compared with soma 
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trays of the counter current type without downcomer (4). It can 
be concluded that the pressure drop through the D.G.T. is smaller 
than those through other trays. It is, therefore, expected that 
a larger volume of gas can be treated with this type of tray than t 
with other trays. Furthermore, it is interesting to note that 
the behavior of the tray is similar to that of the Ripple tray, as 
shown in Figure 2. From Figure 3, it is also evident that the liquid 
holdup on the D.C.T. is smaller than those of other types. This is 
probably due to the fact that the falling of liquid through the tray 
is made easy by the down guide. 

The residence time of liquid on the tray was measured exper- 
imentally, and the desorption experiments were carried out by using 
the water-oxygen-air system to determine the liquid phase resistance to 
the mass transfer (5). The gas absorption experiments were carried out 
by using the water-ammonia-air system to determine the gas phase reisltance 
to the mass transfer (5). The results of these experiments have indicated 
that the gas flow rate and the residence time of liquid on the tray control 
strongly the plate efficiency. The Murphree plate efficiency of this 
tray for gas absorption based on the liquid phase is compared with 
those of other types of trays as shown in Figure 4. It can be concluded that 
the rotational current troy can be operated at high efficiency up to 
large gas flow rate. 

The tray type centrifugal contactors are used for gas cleaning 
and dust collection in air pollution control. Ono particular tray, 
the Kcttcl tray, luts bean extensively used for air pollution control 
In Europe. 



2 . M echa n ically agitated typ es 


The rotating ccne column (6, 7), the rotating basket column, the 
rotating fiat plate column, and the spinning band column (8, 9, 10) 
belong to this class of distillation columns, each containing a rotating 
agitator which disturbs both the gas and liquid phases. The small 
laboratory scale columns of these types perform excellently and are effer ive 
for the separation of components from a mixture with a narrow boiling 
temperature range, for instance, the separation of isotopes (6). The mech- 
anism of flow of both gas and liquid in these systems is not yet well known 
and the prediction of the capacity in these systems can not be made accurately. 
Therefore, it is difficult to design a commercial tower of this type. 

The rotating concentric tube distilling column (11) Is similar to 
the rotating cone column, the rotating basket coluun, the rotating flat plate 
column, and the spinning band column. The column has the characteristics 
of the small liquid holdup and the low pressure drop which is similar to 
that of the wetted wall column, and of the high flow rate. The liquid 
contacts with the vapor in the narrow annular space between the stationary 
outer cylinder and the rotating inner cylinder. The mass transfer 
coefficient Increases as the speed of the rotor becomes greater because 
the flow of vapor is disturbed by the rotation of the inn^r cylinder. This 
can be seen from the results of the investigation by Taylor (12) and 
Lewie (13), who studied theoretically and experimentally the mecnanism of 
fluid flow In an annular space between the rotating double cylinder. It has 
been theoretically determined that the efficiency of distillation increuscs 
with the Increase in the degree of turbulence in the vapor phase and with the 
decrease in the annular apace and in the flow rate through the annular space 
(14). This fact has also been confirmed experiment ally (15, 16, 17, 18). 
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Willingham and coworkers (11) carried out experiments in a column 

with a diameter of 9.62 cm and a height of 58.4 cm. The column was 

provided with a rctor with a diameter if 7.44 cm which was operated at 

speeds in the range of 0 ' 4^000 R.P.M. The feed in liquid form was 

3 

naintainad in the range of 600 “v* 4,700 cm /hr. The pressure drop was lower 
than those of similar type columns described previously and it increased 
with the revolution speed of the rotor and with the flow rate of liquid, 
as shown in Figure 5. 

If it is assumed that the surface of rotating cylinder is not wetted 
and that the rate of reflux which flows down along the inner wall of a 
stationary cylinder is independent of the rotation of the cylinder, the 
liquid holdup can be calculated by the following equation (19) . 


w 


3 0)1, 1/3 

( f) 

p t 8 


( 1 ) 


where w is the thickness of liquid film, Q is the volume flow rate per wetted 
perimeter, p and p are the viscosity and density of liquid respectively, 
and g is the acceleration of gravity. 

The values of holdup calculated from .equation (1) for the rotating con- 
centric tube distilling column are shown in Table 1. The number of thcorutlcal 
places decreases with the Increase in flow rate and increases with the speed 
of revolution, which is illustrated in Figure 6, A high efficiency is obtained 
above the speed of about 2,300 R.P.M. , as shown in Figure 7. The reason may 
be due t6 the fact that the vapor phase becomes highly disturbed above this 
critical velocity. 
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In a plate column, the gas bubbles are passed Into a liquid holdup 
through the submerged openings in the tray to increase the contacting area 
of the gas and liquid. The amount of agitation that can be obtained in 
this way is limited essentially by the rate of gas flow. 

The tank with an agitator is a more efficient device than the plate 
column for agitation of the liquid on the tray regardless of the gas through- 
put. The tank, therefore, may have to be used for the agitation of viscous 
liquids or slurries. Since the agitation also increases the residence time 
of the bubbles in the liquid, the tank may be an efficient device 

where absorption is accompanied by a chemical reaction especially a slow 
reaction (20). 

*■ 

It has also been reported that a horizontal cylinder with an agitator 
can be used for the absorption operation (21) . The agitator consists of several 
discs fixed to a rotary shaft placed in the center of a horizontal cylinder. 

The structure of the disc is shown in Figure 8. The liquid fed near the end 
of the cylinder flows through the discs in the form of sprays, sheets, and 
droplets by centrifugal action. The gas is sent through the cylinder co- 
currently or countercurrent ly to the liquid. According to the studies by 
Cans and coworkers (22), this absorber is highly efficient, but its performance 
and efficiency for Industrial scale operation are unknown. 

These systems with agitators have been reported in detail (23, 24). 

3. Rotating types 

Recently centrifugal contactors .consisting of all rotating parts have 
been developed for mass transfer operations. Many of these contactors have 
been described in detail (21). 
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The Podobiclniak centrifugal rectifier used, in the distillation 
operation belongs to this class of contactors (25). The main part of the 
rectifier is a rotating drum made of a spiral metal sheet. The liquid 
fed near the center flows in radial direction by the centrifugal action 
as a thin film along the metal sheet. The apparatus can be operated at a 
relatively large flow rate without any entrainment which decreases the 
distillation efficiency. It has been reported (26) that when a small apparatus 
•with a rotating drum made of a metal strip, 1/4 inch in width, 100 feet in 
length, and 1/8 inch for distance between coil of spiral, is run at a speed 
of 1,200 R.P.M., the approximate feed rate is 12 liter/hr, the liquid 
holdup is 30 liter/hr, the pressure drop ranges from 10 to 20 mm llg, and 
its efficiency corresponds to that of a 80 plate column. 

The rotary surface vapor compression still whose main part consists of 
the conical disc was fabricated in 1952 by Hickman (27). This apparatus has 
been further developed for application to sea water distillation (27) . The 
schematic diagram of the apparatus is s^ own in Figure 9. Feed water is 
supplied to the inside surface of the rotor and vapor is condensed on the out- 
side surface. The industrial scale rotary surface vapor compression stills have beet 
in operation for several years. To be able to design this system intelligently, 
however, the mechanism of the evaporation and condensation on a rotating heat 
transfer surface must be known. 

The penetration theory (28) and the surface renewal theory 
(29) predict that the absorption rate on the renewed surface of liquid Is 
excellent. These theories may be employed generally for the design of con- 
tactors by utilising the centrifugal action. For example, these theories can 
be applied to the Ptassa type centrifugal absorber. As shown In Figure 10, 
the absorber consists of several concentric cylinders fixed to a rotating shaft 
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. • ■••voral stationary cylinders. The liquid fed near the center flows 

, ;:.e periphery of a rotary cylinder by centrifugal action as sprays, 

-i.; , and droplets, and then collides with the wall of a stationary 
c;-'. incur. After the impact one part of the flov; backmixes with the sprays 
t.'.c other part flov;s down along the cylinder wall. 

On the other hand, one of the authors and his coworkers (30) have 
dei/ned a centrifugal contactor of the rotating type whose main part con- 
sists of multistage concentric perforated cylinders. The schematic diagram 
of tite contactor is shown in Figure 11. The liquid fed near the center of 
the cylinder is spouted from a small hole drilled through the rotating 
cylinder wall, and gas is sent cross currently to the liquid in an annular 
space between the rotating cylinders. 

To understand the fluid dynamic and mass transfer aspects of these 
rotating type contactors, investigations on the gas absorption by the short 
liquid jets (31) and the droplets issued from a capillary (32) in the 
gravitational field have been carried out. Furthermore, the fluid flow and 
mass transfer in the centrifugal field have also been investigated (33, 34, • 

35, 36, 37). 

The distribution of droplets which are broken off from the liquid jet 
issued from a rotating cylinder and a spinning cup has been studied by Walton 
and Prewett (39), Adler and Marshall (40), and Hinze and Milborn (41). The 
photographic observation of the flow pattern of liquid jets injected from a 
rotating cone cup has indicated that the liquid from such a cup forms a sheet 
or film, at the periphery of which the liquid Jets are formed and break into 
droplets. Furthermore, Hinze and coworkers (41) have investigated experimentally 
th>.: effects of the speed of rotor, the flow rate of liquid, and the angular 



vi Unity of the cup on the flow mechanism* Figure 12 shows the distribution 
of the drop diameter as a function of the rotating velocity. These 
expo rlmental results were obtained with a cup having a diameter of 10 cm 
operated at the liquid rate of 80 lirer/hr. Walton and coworkers (39) 
have found that the drop diameter goes through the maximum value vhuu Lhe 
angular velocity is increased and that the drop diameter is given by the 


equa tion. 


d 


u Dp t 


( 2 ) 


where d and D are the diameter of the drop and that of the cup, respectively , 
w is the angular velocity, o is the surface tension of the liquid, and K is a 
constant. Although equation (2) agrees with the experimental results of Ulnae 
and coworkers (41), it docs not contain the effect of Che viscosity of 
liquid. 

Dixon, Russel, and Swallow (42) have investigated the effect of the 
density, viscosity, and surface tension of the liquid. Furthermore, they 
have carried out a theoretical analysis, by assuming that the different behavior 
of the formation of sheets in the different liquid is due to the trajectory 
of the liquid r low from a feed tube to the periphery of a cup. 

As a part of the fundamental studies of fluid dynamics of tho centrifugal 
contactor of the rotating type (30), the first author defined 
theoretically the discharge coefficient in the centrifugal field, neglecting 
the effects of the physical properties of liquids but taking into account the 
effects of hole diameter, wall thickness, cylinder diameter, revolution speed 
of the cylinder, and discharge pressure of liquid (33). Eventually, the effects of 
viscosity and surface tension of discharged liquids were taken into account 
and the equations applicable to the llqulda of varloua vlacoaltlea and nurfaco 
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tensions in the centrifugal field were derived (33) . Other studies 
on the flow pattern of a round liquid jet in the centrifugal field 
are a study of the discharge from a rotating pipe (43), a study of the 
discharge from an orifice (37), and a study of the atomizing pattern of 
liquids spouted from a cylindrical nozzle (44). 

The flow pattern of the liquid jet spouted from a rotating small hole 
is very complex. However, it is known that the jet travels due to the 
combination of the circumferential velocity and the radial velocity (37). Therefore, 
it is clear that these give rise to the relative velocity against the surrounding 
gas. As the discharge velocity of liquid is increased, it undergoes transition 
consecutively through the stages of drops, laminar flow, turbulent flow, and spray. 
Figure 13 shows the most typical forms of liquid jet spouted from a rotating 
small hole (38) . In this figure, (a) is the dripping flow, (c) and (d) arc 
the laminar flow, (e) is the turbulent flow, and (g) is the spray. It can be 
seen that these flow patterns in the centrifugal field are similar to those 
in the gravitational field. 

According to the experimental results of Tanazawa, Kurabayashi, and 
Salto (43), the flow pattern of liquid jet in the gravitational field can be 
divided as follows: 

Je <0.1 dripping 

Je & 0.1 % 10 laminar flow 
Je & 10 % 500 turbulent flow 
Je > 500 spray 

where the Jet number of liquid stream, Je, la defined by 


* * «>. 0.45 

Je - ( -~R)(--A) 


O) 
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and d is the diameter of hole, w is the discharge velocity of liquid, and 

p is the density of gas. 

8 

Fur thermore, from the available experimental results (35), it can be 
seen that the flow pattern of the liquid jet in the centrifugal field must 
be defined by the Jet number based on the resultant velocity as mentioned 
previously. 

The diameter of the liquid jet gradually becomes smaller due to the 
increase in the rotation of speed. Figure 1A shows the relation between the 
jet length and the ratio of jet and hoie diameters, d^/d.when the radius 
of cylinder is 2.5 cm (37). From the figure, it is obvious that the diameter 
of liquid jet decreases as the jet lengthens. The diameter of the jet when 
the discharge velocity is slow and angular velocity is high becomes remarkably 
small immediately after the liquid is spouted from a hole. Hereafter, the 
continuous length of liquid jet becomes short although the flow of jet is 
laminar, as shown in Figures 13(c) and (d) . This phenomenon can not be 
found in the liquid jet spouted from a small hole In the gravitational field. 

In these rotating type gas-liquid contactors, mass transfer takes place 
at the surface of the rotating liquid jets, sheets, droplets, and liquid 
film along the inside wall of the cylinder. It Is Important to know which one 
of these controls the mass transfer rate so as to design an apparatus of high 
efficiency and to determine the optimum condition for operation. 

When a small scale Piazza absorber with two rotary cylinders as shown 
in Figure 10 was operated cocurrently, the following results were obtained (AS) . 
The absorption rate, was Independent of tho Intevfaclal area which was provided 
by tho liquid films along the inside wall of the cylinders when tho intevfaclal 
area of the sprays from the rotating cup was maintained constant. However, when 
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tl,c- interfacial area due. to the sprays was reduced to half and that dut 
to the films was maintained constant, the absorption rate became half 
can be seen from the results that the spray from the rotating cup com 
the overall absorption rate. 

On the other hand, in the rotating type contactor (30), mass transfer 
between gas and liquid takes place as a result of contact between gas and 
a liquid jet or g. s and a liquid film along the inside wall of the (.ylindnv. 
in order to evaluate the rate of mass transfer from rotating liquid jets, 
the contact area of gas and liquid per unit volume of a continuous liquid jet 
spouted in an annular space from a small rotating hole has been determined 
theoretically and experimentally (37). Furthermore, the absorption of pure 
carbon dioxide by a liquid jet issuing from a rotating hole (35) and that l>y 
a flowing liquid film along the inside wall of the rotating cylinder (36) 
have been studied. It can be concluded from the results that the amount of 
mass transfer into the liquid film on the wall of the rotating cylinder is 
much less than that into the liquid jet issuing from a rotating hole. However, 
the absorption efficiency increases as the liquid depth on the inside wall 
decreases. 

The pressure drop under the condition of the cocurrent flow of gas and 
liquid in the Piazza absorber is affected by both the rotating velocity and 
the liquid flow rate. The liquid holdup in this apparatus Increases when the 
speed of revolution is lowered. This Increase in the liquid hold-up tends to 
obstruct steady flow of gas and consequently Increases the pressure drop steeply. 
This is the so-called flooding phenomenon. The point of flooding depends on 
the flow rate of liquid but ia almost Independent of the gas rate. In the 
countercurrent operation of thia apparatus, theae relations are complex. 

As mentioned previously, It is desirable to make cylinders an large an 
possible for the purpose of Increasing efficiency of absorption. For absorption 
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the space between cylinders must be narrow. However, this tends to increase 
the pressure drop. To solve this problem a number of holes is often provided in 
the bottom of the rotating cylinder. Even with this improvement, the liquid 
throughput in radial direction cannot be maintained smoothly because the 
main part of the absorber consists of the rotary cylinders and stationary 
cylinders, which are overlapped. As a result, the consumption of power is 
enormous, flooding tends to occur and the countercurrent operation becomes 
difficult. To avoid these difficulties Alcock and Millington (46) designed 
the double rotor contactor. The experimental results (46, 47) Indicate that 
the pressure drop for the double rotor type is 1/2 to 1/3 of that of the 
rotor stator type. The double rotor type is more desirable than the rotor 

m 

stator type for the treatment of viscous liquid.- However, the behavior of 
liquid flow into the contactor has not yet been investigated. In the centri- 
fugal contactcr of the rotating type (30) , the pressure drop is much smaller 
than that of the Piazza type because the gas is sent crosscurrently to the 
liquid jet in an annular apace between the rotating cylinders. 

Rumford and Rae (47) have investigated experimentally the effects of 
the water rate, the gas rate, the concentration of the solute gas, and the 
revolution speed and structure of cylinders on the absorption rate in the 
Piazza absorber of the double rotor type operated cocurrent ly. They have 
employed three systems, namely, carbon dioxide-water, ammonia-water, and 
acetone-water. Table 2 shows the experimental results obtained at various 
flow rates of the liquid and gas. If the total volume of the centrifugal 
absorber is V ft*, and if C # moles of gas flow cocurrantly with moles of 
liquid, the following aquation can be obtained from the material balance (47). 

-C, dy * \ dx - k t a(C # - C 4 )dV (4) 


A 

Vr 
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where k a is the liquid phase coefficient on the volume basis, C is the 
X € 

concentration of solute in liquid stream which is in equilibrium with gas, 

C is the concentration of solute in the main body of the liquid stream, 
x» 

and x and y are mole fraction of solute in liquid and gas, respectively. 
The number of liquid phase transfer unit, N , is 

X 


N - V • c • K a/L 
t i « 


(5) 


where c is the average molal density of the liquid. Then, the volume of a 

liquid phase transfer unit, V/l? , is 

X 


V/N - L/c • ka (6) 

£ © £ 

This is often denoted as V.T.U.^. And alternatively the volume of a gas 

phase transfer unit, V.T.U. or V/N , defined as 

8 8 

V.T.U. s V/N = G/P • k a (7) 

8 8 ■ 8 

where P is the total pressure of the system. Then the volume of an overall 
liquid phase transfer unit, V.T.U.q^ is given by 

V.T.U. ft - V.T.U., + (L /C • M) (V.T.U. ) (8) 

01 1 • *» g 

where M represents C/H.P., in which H is the Henry's law constant. On the other 
hand, the volume of an overall gee phase transfer unit, V.T.U.^, la 

V.T.U. og - V.T.U. g + (G b • H/L^) (V.T.U . g ) (9) 

As mentioned previously, values of these quantities ere given in Table 2. 

Figure 15 shows one example of the effect of the rotating velocity on the 
absorption rate. This result was obtained at the gas rate of 1,100 ft*/hr. 




The concentration of carbon dioxide in the inlet gas was 17X and the cone e» - 
(ration of monoethanol amine and that of carbon dioxide in the inlet solution 
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were 80% and 3.5% respectively. Furthermore, Alcock and Millington (46) 
found the optimum condition from their experimental results obtained by using a 6 
cylinder unit and designed a large scale absorber in which 15 cylinders were fi);ed 
to a rotor, 12 Inches in diameter, and have examined it with the monoethanol 
a..iine-carbon dioxide systems. The experimental result obtained with both 
equipment are compared in Table 3. 

The absorption rate of pure carbon dioxide gas by a rotating round 
water jet was measured in an annular space between the rotating cylinder and 
a stationary concentric outside cylinder (35) . Figure 16 shows an example of 
the relation between the gas-liquid contact time, 6, and the Murphree 
absorption efficiency, when the hole Is 0.9 mm in diameter. 6 was evaluated 
by the theoretical equation (35, 38). From this figure it can be seen that the 
plot of versus /O leads to a straight line through an origin, and also 
that the pure carbon dioxide gas absorption by a water stream 
Issuing from rotating jet holes conforms to the unsteady-state diffusion 
theory (28). Furthermore, the gas absorption rate by a water jet spouting from a . 
rotating small hole was observed to be large immediately after the liquid 
was spouted from the hole. Therefore, for practical purposes, it is desirable 
to employ a multi-rotor type contactor in order to make as many jets of liquid 
as possible. 

In addition to the experimental mass transfer study mentioned previously, 

n.chanlsas of fluid flow and the mass transport of the liquid film on the In- 

• • 

Alda wall of a rotating watted cylinder ware theoi-tlcally investigated (36). 

The affects of various factors such as the gas and liquid velocities, the 
depth of liquid layer, the number of revolutions, and gas-liquid contact time 
ate. on the mass transfer rate were examined. 
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The centrifugal contactor of the rotating type (30) has been extensively 
developed in Japan as absorbers, humidifiers, rectifiers, etc. based on the 
fundamental and applicative studies by the first author and his coworkers 
(33, 34, 35, 36, 37, 38, 4<J) . 

Some of the special features of gas-liquid contactors utilizing the 
centrifugal force are discussed in this report. These contactors have come 
into general use only in the last ten years and there is as yet no literature 
that deals with design features and fundamental studies, and many problems 
are yet to be solved. However, it is expected that these contactors will be 
employed widely by several Industrial fields in the nea.r future because of 
the generally favorable mass transfer characteristics in the centrifugal field. 
Some contactors mentioned in this report allow treatment of a viscous solution, 
and also can be operated without flooding and at a large flow rate. Furthermore, 
they can be employed where pitching and rolling of the systems cannot be 


avoided 
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Liquid flow 
[ml/hr] 

1,000 

1.500 

2,000 

2.500 

3.000 

3.500 

4.000 


Table 1. Holdup 


Holdup 

Holdup 

Column height 
[ml/m] 

Number of theoretical 
Plate 
[ml] 

12.8 

0.10 

14.5 

0.14 

15.9 

0.19 

17.2 

0.24 

18.2 

0.29 

19.2 

0.36 


20.1 


0.40 






Table 2. 


L 

m 

G 

m 

N o* 

V 

v - T * u -ot 

V.T.U. ( 

22.2 

3.66 

0.825 

0.00352 

0.04 

9.4 

44.4 

3.66 

0.825 

0.00704 

0.04 

4.68 

66.6 

3.66 

0.825 

0.01056 

0.04 

3.12 

88.8 

3.66 

3.850 

0.01450 

0.039 

2.28 

111.0 

3.66 

0.870 

0.01850 

0.038 

1.79 

44.4 

1.83 

0.56 

0.0095 

0.059 

3.48 

44.4 

2.45 

0.56 

0.0072 

0.059 

4.60 

44.4 

3.06 

0.56 

0.00575 

0.059 

5.75 

44.4 

3.66 

0.56 

0.0048 

0.059 

6.89 


Og 


6% C (>2 In gas 


O 


9Z C0 2 In gas 
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Table 3. Comparison of 6 Cylinder and 
15 Cylinder Absorbers 



6 Cylinder Absorber 

15 Cylinder Absorber 

Liquid flow 
rate 
[gal/hr] 

Absorbed 

k a C0 o 

g 2 

[lb /hr] 

Pressure 

drop 

[in-W.C.] 

k a 
g 

Absorbed 

C0 2 

[lb /hr] 

Pressure 

drop 

[ in-W . C . ) 

20 

7,700 13.1 

5.5 

31,000 

17.6 

12 

30 

10,500 16.9 

5.5 

41,000 

19.6 

14 

40 

12,700 18.3 

5.5 

47,300 

20.5 

16 


Concentration of Inlet liquid 
Temperature of inlet liquid 
Gas flow rate 

00^ concentration of inlet gas 
Number of revolution 


85% M.E.A. 2.5% C(> 2 
60*C 

1,200 ft 3 /hr 
16Z 

2.300 R.P.M. 







































Liquid holdup on a troy [g/cm*] 



Fig. 3 Comparison of liquid holdup on 
various counter-current trays. 
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Fig. 4 Comparison of obsorption efficiency 
based on liquid phase . 
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Fig. 13 Flow pattern of rotating liquid jet . 
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For a man to survive in any surroundings, he has to maintain 
breathing, drinking, eating, and activities related to waste elimination. 

In solving the problem of the life support in space vehicles, the control 
of atmospheric temperature, humidity, carbon dioxide level, trace contaminant 
level, provisions for waste elimination, and the supply of oxygen, food and 
water must be considered. Life support systems are often categorized 
in terms of the extent to which the human waste products are reclaimed, 
that is, the degree of ecological closure. The possible degree of closure 
ranges from open systems which provide no waste recovery processes, to 
partially closed systems which provide recovery processes for water and or 
oxygen, and to closed systems which provide food and all other life support 
needs from the processing of the human wastes (1). 

The removal of carbon dioxide from the enclosed space or cabin atmosphere 
one of the important functions of a life support system. The concentration 
of carbon dioxide in normal air is usually taken as 0.03% by volume. The 
air exhaled by the breath of man contains approximately 4*5% of carbon 
dioxide. Therefore, there can be an appreciable build-up of carbon dioxide 
in any enclosed space. 

Processes for the removal of carbon dioxide from gas mixtures have 
been sufficiently developed in the chemical industry. In aerospace application 
however, uses of many of the techniques will be restricted severely by 
weight, power, and volume of the process units and other characteristics of 
the processes . In addition, the processes must be operated in the zero 
gravitational field. 

Various promising methods for the removal of carbon dioxide in the 
cabin of space craft have been proposed. In the future, however, many other 
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different methods will probably be proposed for different systems with 
different degrees of ecological closure. 

The portable life support system to keep man alive and comfortable 
outside the space capsule is also needed. Reid and Richardson (2) 
reported a new process for the removal of carbon dioxide in the portable 
life support system. They have concluded that when ease of handling and 
safety are considered, when heats of vaporization are examined, and when 
other thermal and physical properties are evaluated, water is still the best 
absorbent (2). However, since the solubility of carbon dioxide in water is 
very low, a high water flow rate is necessary to increase the removal of 
metabolic carbon dioxide. For these reasons, the use of a jet momentum pump 
for absorption and a centrifugal contactor with turbine blades for desorption 
has been suggested in the process. This appears to be one of the promising 
methods for carbon dioxide removal in the air and space crafts. 

The processes and contactors which can be operated in air and space 
crafts are few because they are restricted by the conditions mentioned 
previously. Contactors, which can be operated in the zero gravitational field and 
which are reviewed in this report, Include the packed beds filled with adsorbent 
particles, venturi contactors, and centrifugal contactors. Emphasis will be 
placed on the description on one of the centrifugal contactors (3) . 

Packed Bed 

The adsorption method has been developed recently because it can easily 
be designed for operation under the condition of weightlessness. 

The typical system has two beds of molecular sieve connected in parallel. 
While one bed is adsorbing carbon dioxide from the exhaust cabin air, the 

m 


otlu*r is being regenerated er (b-.erhed . 


The denar p t ion of t m hid i* 


usually accomp I i she J bv applying iie.it, vacuum or a combination of hotii 
after the bed has been isolated fiom the removing process (4). 

Detailed reviews and studies (4, 5, b) on the use of mole< ular sieve 
for the removal of carbcn dioxide are available. 

The pressure drop :>f gas through the bed of the adsorbing particles is 
generally not small. Therefore, if the duration of a space mission is pro- 
longed or if the size of the cabin space is increased, the weight and volume 
of the bed and the power required to operate it may become excessive. 

Venturi Contactor 

Venturi contactors were originally developed for the purpose of dust 
and mist separation. In one mode of operation the gas to be scrubbed is passed 
through a tube where low pressure liquid is injected into the gas stream at 
the high velocity throat section of the tube. A high degree of liquid 
dispersion is attained when the gas velocity is high. On the other hand, 
the introduction of gas at the throat of the venturi, through which a liquid 
stream flows, results in a mixture of finely dispersed bubbles in the liquid. 
Both situations give rise to the effective mass transfer in the venturi con- 
tactor (7). 

In general, the venturi contactor has a high capacity and an appreciably 
low energy requirement for a given amount of solute gas transfer. In addition, 
it can be directly incorporated into any process without additional equipment. 
Therefore, the capital cost of a venturi contactor is low compared to an 
absorption column. For these reasons, venturi contactors can probably be 
employed advantageously for the purpose of removing carbon dioxide in space 
crafts. However, the published studies on the mass transfer characteristics of 
the venturi contactor are few. One shortcoming of the venturi contactor is that 





the pressure drop of fluid through a venturi is generally high because rhe 
fluid throughput must be maintained at a high level. 

Centrif ugal Contacto r 

Recently centrifugal contactor; consisting of all rotating parts in 
which mass transfer operations are carried out have been developed (8, 18) . 
These contactors are not influenced by gravitational force and have the 
characteristically high gas and liquid throughput, small holdup, short con- 
tact time, and high efficiency. 

Takahashi (8) has established the design method for a n*»w centrifugal con- 
tactor (3) whose main part consists of double or multi-stage concentric 
perforated cylinders. The schematic diagram of the contactor is shown 

in Figure 1. The liquid fed near the center of the rotating cylinder via a 
rotating hollow shaft is spouted from many small holes drilled through the 
wall of the cylinder into an annular space formed by the double cylinders. 

The gas is sent cross-currently to the liquid jet in an annular space. Mass 
transfer between the gas and liquid takes place as a result of the contact 
between th* gas and the liquid jet or the gas and the liquid film on the in- 
side wall of the rotating wetted cylinder. 

Some of the fundamental data required for designing this contactor are 
given in this report. 

In a multi-stage centrifugal contactor of the cross-flow type, the 
discharge velocity of the liquid from a rotating small hole is influenced 
by the diameter and length of a hole, the diameter of the cylinder, the 
pressure of the inlet liquid, the depth of the liquid holdup in the cylinders , 
and the revolution speed of the rotor (12, 13). For a stable operation, 
the flow pattern of the liquid jet and the discharge coefficient must be 
considered first in the designing of this contactor. 



Flow pattern of the liquid jet 

As the discharge vt loci tv increases, the flow pattern of the liquid 
issuing from a rotating nozzle or orifice becomes dripping flow, 
laminar flow, turbulent flow, and sprav. This mode of flow pattern change 
is the same as that in the gravitational field (9, 10). Since gas flows 
normally to the rotatirg liquid jet, the behavior of the liquid jet in the 
contactor is 'nfluenced not only by the disturbance in the liquid but also 
by the friction with air. The breakup length of the laminar liquid jet 
increases with the discharge velocity. When the viscosity of the liquid 
increases, the breakup length becomes lor^er and the critical velocity to 
the sprav tends to be higher at the low velocity. The effect of the 
surface tension on the contraction of the liquid jet may be negligible when 
the Weber number exceeds 4 (10). These results show that the flow pattern 
of the liquid depends on the Reynolds number Re^, the Jet number Je* and 
the physical properties of the liquid (11, 16). The Reynolds number based 
on the hole diameter indicates the. degree of the turbulence in the fluid. 
The Jet number based on the relative velocity determines the effect of the 
resistance of the surrounding gas. 

Discharge coefficient 

If the coordinate system rotating at a constant angular velocity* o> t 
is used* and if the Coriolis force is omitted* the Bernoulli equation for 
the centrifugal field Is represented by 

2 2 

4 (v*) 2 - - + gz - const. (1) 

* l P 

where v* is a relative velocity of fluid with respect to the rotating 
coordinates. 





By using the boundary conditions at I and IT in Figure 2, 


U 


B. 

c. 

1: 

r = Rj, 

>>i ■ V 

V* = 0 

(2) 

b. 

c. 

2: 

r » R 2 , 

P 2 = **2’ 

V* = w 



the expression for the discharge velocity w i9 obtained as follows: 

v - ^2 — + "(R? - r!7u? (3) 

* p 2 1 

where the pressure difference AP is given by 

AP * p i - P 2 (4) 

Therefore, the flow rate Q is given by the following equation in an ideal 
case. 

Q - wf 2 - C c f yV ^ + (R 2 2 - R x 2 ) U) 2 (5) 

where f 2 is the cross-sectional area of Jet spouted from a small hole and 

f is the cross-sectional area of the hole. Contraction coefficient C in 

c 

Equation (5) is defined by the equation 

C c - f 2 /f (6) 

In practice, however. Equation (5) does not hold because of various losses 
of fluid flow, and the discharge coefficient should be defined by the 
following equation (12). 

Q - Cf ^2 ~ + (R 2 2 ~ R 1 2 )u> i { C - C c • C y (7) 

where C Is the discharge coefficient in the centrifugal field and C y is 
the .diocity coefficient. 
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Solving the Navier-Stokes equation for the motion of fluid in the 
concentric double cylinder with the boundar^ conditions (see Figure 3). 


B. 

C. 

1: 

r =* 

r i» <*> = Wjt 

B. 

C. 

2; 

r = 

t 2 > (i) — (^2 * 


the following equations are obtained. 

... x 1 r , 2 2 


2 2 

1 2 2 r l r 2 

v e (r) “ 2 ^“2 r 2 " “l r l^ r — ^2 ~ 


r 2 “ r l 


P(r» z > “ P i< z > + "2 ' 2 ’ 2 l(w 2 r 2 ~ “l r l ) 


2 2 
2x2 r 7 r l 


X / X Xx 4. (. X X X X- 

r 2 - r l> 

4 4 

„ 2 2 , w .2 2, , r r l r 2 , ,2.1 1 „ , 

- 2r x r 2 (u 2 - r 2 - uij r.^ In 2 — ( u> 2 - u^) (-^ 2 ) ] (10) 

1 r r, 


where z indicates the axial coordinate in the direction of gas flow. For the 
fluid within the rotating cylinders, the boundary conditions are 
B. C. 1; r x -*• 0, - 0, p - Pj *= P g 

(ID 

B. C. 2; r - r 2 - w 2 - w, p * Pj 

Thus, the pressure P^ at the inner wall of the cylinder becomes (12) 

„2 2 

R. w 

P 1 “ P s + "V P < 12 > 


Consider the case in which the outer and inner cylinders rotate with the 
constant angular velocity u as shown In Figure 4, and In which a heaw 
liquid is Issued through holes because of the centrifugal pressure due to 
the difference in density. For this case the following equations are obtained 
by substituting u ■ ■ « 2 l nt0 Equations (8) and (9), 
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V Q (r> = r ui 

(13) 

2 

P(r, z) = P 1 (z) + (r 2 - r 2 ) 

(14) 


Equation (13) shows that the fluid filling the horizontal cylinder rotating 
with a constant angular velocity u> rotates around a horizontal axis as does 
a solid rod (12, 13). 

Assuming that the light liquid phase (or gas phase in case of a gas-liquid 
system) is continuous, the pressure difference between Rq and in the heavy 
liquid phase (or liquid phase in case of a gas-liquid system) is obtained from 


Equation (14) as ? 2 

p p <R 1-V 2 

P 1 - F 0 ’ P h 2 “ 


(15) 


The pressure difference between and in the light liquid phase (or gas 
phase in case of a gas-liquid system) is also similarly obtained as 


P 


2 




(16) 


Substituting Equations (15) and (16) into Equation (7) the following 
equation is obtained. 


Q 


C.f 



R 0> 


W 


(17) 


This equation defines the discharge coefficient for the liquid-liquid svstem in 
the centrifugal field. When p^ >> p^, Equation (17) becomes (14) 

Q - C.f.uiyR 2 - rJ (18) 

which defines the discharge coefficient for the gas-liquid system for the case 
in which the liquid film on the inside wall of the rotating wetted cylinder 
is issued through a hole. 
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Pressure loss 

The pressure loss of the gas which flows crosscurrently to the liquid 
jet in an annular space can be computed from the following empirical 
equation (15). 


Ah 


3.5 2 1.83 _l/3 x .2/3 ^3 

, p w v D. N d 

0.ixlO' 6 -S— 1 


2.5 


_0.17 
n D 2 
Z e 5 


(19) 


where D e (® - D^) is the equivalent diameter. This equation indicates 

that the pressure loss of the centrifugal contactor is very small. 


Mass transfer ' 

In a centrifugal contactor, mass transfer between gas and liquid takes 
place as a result of contact between gas and liquid jets and that between gas 
and liquid film on the Inside wall of the rotating wetted cylinder. According 
to the experimental results (16, 17) the extent of the mass transfer into a 
liquid film on the Inside wall of the rotating wetted cylinder is much less 
than that into a liquid jet Issued from rotating holes. 

The liquid phase capacity coefficient for the liquid jet from a rotating 
hole was measured experimentally by using a pure carbon dioxide-water system 
(16). The result is expressed as 

D. 1/2 - R, N* a 

h* ■ ”<«?> <-rar>Hr-> ' 20 > 

a 

where N' Is the revolution speed of the rotor (r.p.s.), D L is diffuslvity 
In liquid phase, n Is the total pressure, and the power a Is given by 


a - 0.72 


when d > 1.0 ram 
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a 


3.93d 


0.74 


when d < 1.0 mr 


The contacting time between gas and liquid 0 can be determined theoretically 


as (11) 




e. = 


2 V 2 2 

- D(-“') +m 

1 w 


- R. 


R a) 2 

v/{(~) + 1} 


w 


( 21 ) 


where 


m 


W R 


1 


According to the experimental result of adiabatic humidification in 
the contactor, the gas phase capacity coefficient for the liquid jet from a 
rotating hole can be expressed as 

a- 0.422 x 10 -3 n'(NR 1+1 ) 0,5 G 0,8 (22) 

where G is the mass flow rate of air, and n' ia the number of holes. 
Stability conditions for operation 

In the design of a centrifugal contactor, the stabllit; ndition 
for operation must be considered. Since the discharge pressure of the 
liquid from a hole in the first cylinder cen be fixed arbitrarily as shown 
in Figure 5, we shall first analyze an arbitrary stage, say the ith stage. 

Assuming that the pressure drop of gas and that of liquid in the axial 
direction in an annular space formed by double cylinders is negligible in 
comparison with the centrifugal pressure. Equation (17) gives (15, 17) 


Q 


C F 
ii 




( 23 ) 


where 0 is defined as 



( 24 ) 


1 1 


* = ( °h " p H )/p h 


The thickness of cylinder t is given by (R i 
Equation (23), 




Therefore, from 


J Li 


+ t /“ Fr ; 

r = 1 - VI - ( -) 


( 2 :) 


C^B 


it can be seen from the equation that the liquid depth in the cylinder d^ 
depends on R and Fr^ Fr t is the Froude number in centrifugal field at 
the ith stage defined by 


Fr 


i 



R^io 


(26) 


The relaticn of Equation (25) is shown in Figure 6. 

For the design of a multistage centrifugal contactor, the different 

cases where 

(1) cross sectional area of holes drilled through the ith cylinder 
wall, F i , is constant, 

(2) total hole area to cylinder area ratio is constant, 

(3) liquid depth in a cylinder d Li is constant, 

(4) d L1 i3 given, 
can be considered. 

Furthermore, if the discharge coefficient is constant, the liquid 
depth d , the total hole area F., the discharge velocity of liquid w , and 
the ratio of hole area to cylinder area e^ are different from stage to stage, 
as shown in Table 1. They are calculated by equations given in Table 2. 

The discharge pressure of the liquid from a hole in the first cylinder 
can be arbitrarily fixed. Then, it is desirable that the 2nd stage be selected 
as the starting point for the design of the complete system. For designing the 
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2nd stage, the total hole area F 9 must be determined by Equation (23) to 

establish the desirable value of the discharge velocity w 9 and of liquid 

depth d^' Then, according to the predetermined conditions for the design, 

F,, Fr , d , and w are determined from Table 2. Since d 0, the 
1 1 Ll 1 Li 1 

necessary condition for stable operation for the ith stage is obtained 
from Equations (23) and (25) as 




<• 1 


(27) 


If the value of the Froude number satisfies the condition given by 
Equation (27), the contactor will operate stably. 

For a stable operation, it can be seen from Equation (25) that the 
change of the liquid depth is influenced by the discharge velocity of liquid. 

The revolution 3 peed of the contactor is also an important factor. Furthermore, 
it is evident from Figure 6 that d^ changes less in the region of the low 
Froude number at constant C and R. Therefore, the stability increases as F 
and w become larger. When the Froude number is too small, however. Equation 
(27) is not satisfied. And since the stability depends not only upon the 
value of d^ but also on the rate of its change, a small value of the Froude 
number is not desirable because d^ becomes too small. 

As can be seen from the expression of the Froude number, the liquid 
depth in the centrifugal contactor depends on the discharge velocity of liquid 
and the revolution speed of the contactor. This is an Important feature of 
the centrifugal contactor. Suppose that a contactor is designed with the 
condition of the liquid flow rate Q and the revolution speed N. If its 
operating condition is changed to another liquid flow rate O' , and another 
revolution speed N f at which a stable operation is possible* we obtain from 
analogy. 


4 *—- 


”'« r. 






- T 















Fr = Fr ' 


or 



In this case, d^ does not change. However, as the discharge velocity of 
liquid changes from = Q/F^ to = q'/F , the change of the character i st i 
of mass transfer cannot be avoided. This can be seen from Equation (20). 

The number of stages and the magnitude of space between cylinders can be 
determined from the operating condition for the mass transfer. 

This review leads to the general conclusions that the pressure drop of 
gas is small, the throughput of gas and liquid is large, and the mass transf 

m 

rate is efficient in the centrifugal contactor. Furthermore, it can be 
easily operated in the zero gravitational field. Therefore, the centrifugal 
contactor may be suitable for gas-liquid contact operation in air and spat** 


craf ts. 



Nomenclature 


c 

Discharge coefficient in the centrifugal field 

[-] 

d 

Diameter of hole 

I cm] 

d L 

Liquid depth in cylinder 

[cm] 

D 

Diameter of cylinder 

[cm] 

°L 

Diffusivity in liquid phase 

[ cm 2 /sec] 

e 

Ratio of area of hole to cylinder 

[-1 

f 

Cross-sectional area of hole 

[cm 2 ] 

F 

Total hole area of a cylinder 

[cm 2 ] 

g 

Acceleration of gravity 

[cm/sec 2 ] 

G 

Mass rate of air 

[g dry air/sec 

Ah 

Pressure loss 

[cm w . c . ] 

k L a 

Liquid phase capacity coefficient 

[ 1/sec] 

V 

Gas phase capacity coefficient 

3 

[g/cm sec AH) 

n 

Number of holes in axial direction of cylinder 

[-) 

n 1 

Total number of holes ^n a cylinder 

M 

N 

Rate of revolution 

(r.p.m. ] 

P. P 

Pressure 

2 

[dyne /cm ] 

Q 

Volumetric rate of liquid flow 

[ cm 3 /sec] 

r 

Radial distance 

[cm] 

R 

Radius of cylinder 

[cm] 

t 

Thickness of cylinder wall 

[cm] 

V 

Flow rate of gas 

[cm/sec] 

V 

Discharge velocity of liquid 

[cm/sec] 

w 

Viscosity 

[g/cm see] 

p 

Density 

[R/cm 3 ] 
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0 

Surface tension 

[ dyne/cm] 

u> 

Angular velocity 

[ rad/sec ] 

Je 

dw^'p p f 0.^5 

Jet numbers - ( ( — -) 

o o 

8 

M 

Re d 

Reynolds number based on hole diameter j dwp/u 

(-] 

Fr 

Froude number in centrifugal field, * w/Ru) 

[-1 

We 

2 

Weber number » dw p/o 

[-] 
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Applications of Modern Optimal Control 
Theory to Environmental Control of 
Confined Spaces and Life Support Systems* 

Part 1 — Modeling and Simulation 

L. T. FANt 
Y. S. HWANGt 
C. L. HWANGt 

This paper is the first of a series of five containing the results of an original 
investigation of the temperature control of confined spaces such as those in 
any building and life support systems by means of the modern control theory. 
While much of the material presented in this work is original, the series has 
been prepared in sufficiently tutorial styie that it can be used as a text for 
self-study by practicing air-conditioning engineers. It is hoped that this work 
t~~' ' r;, ~ ' v 4 > . will stimulate the applications of and research on the modern optimal control 

' J • theory to the environmental control of life support systems in general, 
including controls of humidity, purity and noise. 

Parts 2-5 wi’l be published in the next three issues of Building Science. 


Several mathematical models of an environmental control system which consists 
of a confined space or cabin, a heat exchanger, and a feedback element such as 
1- -. a thermostat are presented. The performance equations of the system, which 

EXr.1. _ .. .s represent the dynamic characteristics of the system proper and of the heat 


exchanger ( the control element of the system ) are derived. In the basic model 
the flow of air in the confined space is considered to be in the state of complete 
mixing and the disturbance is caused by an impulse heat imput. The performance 
equations in which the heat disturbances are of the form such as the step function 
and cyclic function which are different from the impulse function are also 
derived. Also presented are the performance equations which represent the 
dynamic characteristics of flow of air in a confined space or cabin characterizeu 
by the two completely stirred tanks-in-series (2 CST's-in-series) model. 

To determine the goodness of the system model a computer simulation is 
carried out and the results are compared with the known characteristics of the 
system. 


THIS series of five articles contains results of the 
original investigation on the control of life support 
systems or more specifically the temperature 
control of life support systems by means of the 
modern control theory. A life support system is a 
system for creating, maintaining, and controlling 
an environment so as to permit personnel to function 
efficiently. The control of temperature is probably 
the most important role of the life support system. 

The need for providing an automatic control 
system to an air-conditioning system has long been 
recognized! ’ ,2J. It is also a well known fact that 
use of the automatic control is necessary for the life 
support system of a space cabin or submarine or 

* This work was supported by the Air Force Office of 
Scientific Research, Office of Aerospace Research, United 
States Air Force, Under Contract F 44620-63-0020 fThemis 
Project), and NASA Grant Under Contract NGR-I7- 
001-034. 

t Institute for systems design and optimisation, Kansas 
State Univanity, Manhattan, Kansas. 


underground shelter(3,4J. It appears that analysis 
and synthesis of the control systems for the air- 
conditioning and life support systems have so far 
been carried out by the classical approach[l~4J. 

The classical approach to the analysis and 
synthesis of an automatic control system is essen- 
tially a trial-and-error procedure or a disturbance- 
response (or input-output) approach. Extensive use 
is made of the transform methods such as the 
Laplace transform (i-domain), Fourier transform 
(ce-domain), and z transform (discrete time- 
domain). Even though mathematics is extensively 
used, the classical approach is essentially un 
empirical one(S]. 

In recent years, an approach to the analysis and 
synthesis of a control system, which is distinctly 
different from the classical one, has been developed. 
This modem approach is generally called the 
modem (optimal) control theory (5— 1 1], It is based 
on the state-space characterization of a system. 
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The state-space is the abstract space whose co- 
ordinates are the state properties of the system or 
the variables which define the characteristics of the 
system[5]. This approach involves mainly maximiza- 
tion or minimization of an objective function (func- 
tional) which is a function of state (plant) and 
control variables which are in turn functions of time 
and or distance coordinate. The objective function 
is specified, constraints are imposed on the state and 
decision variables, and an optimal control policy is 
determined by extremiz ng the objective function by 
means of mathematical techniques such as the 
calculus of variations, maximum principle, and 
dynamic programming[5, 6]. This modern approach 
is entirely theoretical in the sense that no trial-and- 
error is involved in “adjusting the controller". 

There are reasons to believe that the classical 
approach suffices in the analyses and syntheses of 
the control systems for a majority of air-condition- 
ing and life support systems because usually the 
requirements are not extremely critical and speci- 
fications are not very tight. It is, therefore, justifiable 
that most of the control and dynamic investigations 
of air-conditioning and life support systems, which 
have appeared in the open literature, are based on 
the classical approachf 12-20]. There is, however, a 
certain incentive in applying the modern approach 
to analysis and synthesis of automatic environ- 
mental control systems in space crafts, submarines, 
underground civil defense shelter i and certain 
medical facilities. In these systems, very stringent 
requirements in the response time, control effort, 
and others are imposed. For example, the control 
system of a space craft must have an extremely 
small response time and furthermore, the amount 
of energy required for the control effort must be 
very small because of the weight limitation im- 
posed on the space craft. 

In the present work, the emphases are on the use 
of the maximum principle and related variational 
techniques[5, 7-1 1]. Their applications will be illus- 
trated by means of concrete numerical examples. 
It is said that use of the maximum principle and the 
calculus of variations gives rise to a control policy 
of an open loop naturel$,21] which is not desirable 
for control of a space heating system in which room 
temperature variations are to be reduced and 
penalized[22). In reference [22], the dynamic 
programming technique is employed. It will be 
shown, however, that the maximum principle and 
related techniques can be advantageously em- 
ployed for the types of systems and objective 
functions considered in this work. 

In this series of presentation, only the modeling 
and control of deterministic systems are considered. 
However, when human and physiological factors 
are taken into account as part of a total life support 


system, use of the stochastic modeling and control 
may be more appropriate than use of the deter- 
ministic modeling and control because the system 
tends to be more stochastic than deterministic. 

It is hoped that this work will stimulate the 
applications of and research on the modern 
optimal control theory to the environmental 
control of life support systems in general, including 
controls of humidity, purity and noise. 

The first of this series of articles on the applica- 
tion of the modern control theory to life support 
systems contains the derivation of the mathematical 
models of several different systems and the simula- 
tions of their behavior and characteristics. In the 
second of the series, the most basic form of Pontry- 
agin's maximum principle, which together with 
dynamic programming constitutes the bulk of the 
modern control theory, is outlined and its use is 
fully demonstrated by means of concrete numerical 
examples. In Part 3 of the series, the optimal 
control of a system with equality state variable 
constraints imposed at the end of the control action 
is considered. The fourth of the series deals with 
realistic problems of controlling systems with 
constraints imposed on the state variable, namely 
the temperature in the systems. In the final part of 
this series, some aspects of sensitivity analysis are 
presented and discussed by fully exploiting the 
results obtained in the preceding parts. 

While much of the material presented in this 
work is original, this series of five articles is pre- 
pared in such a manner that it can be used as a 
text for self-study by practicing life support 
systems engineers or as a text in graduate or ad- 
vanced undergraduate courses concerned with life 
support systems or air-conditioning. 

MODELING 

A control system usually consists of three 
elements: the feedback element, the control 
element, and the system proper[23]. The feedback 
element in a life support control system or an 
environmental control system may be composed of a 
thermostat, humidistat and pressure regulator, or 
any combination of these, depending on the purpose 
of control. The control element may include a heat 
exchanger, humidifier, dehumidifier, blower, por- 
table air-conditioner, or any combination of these, 
depending on the objective of control. For instance, 
both the thermostat and heat exchanger are often 
used to control the air temperature inside a building. 
The system proper may be a confined space, e.g., 
an underground shelter, a space vehicle, & space 
suit, a submarine or a building. 

The system considered here is shown schemati- 
cally in figure 1. The confined space may be a 
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typical office located in a multi-siory building or 
the cabin of a spaceship. Air or oxygen or a mixture 
of oxygen and nitrogen is circulated through the 
room or confined space via an air duct by mechani- 
cal means, e.g., a blower or fan. Control of air 
temperature in the system is accomplished with a 
duct system. The thermostat in the system adjusts 
the position of the control valve of the heat 
exenanger in order to provide the desired tempera- 
ture. 

The performance equations of the system, which 
represent the dynamic characteristics of the system 
and system components will be derived. 




air t ? t. 

or OKyqtn 

Top vitw 


Fig. 1 . Air-conditioned room. 


A. The system proper 

The following three main assumptions are made 
concerning the system proper : 

fi) Room or cabin air is well mixed, or stated in 
another way, air temperature within the system is 
uniform throughout at any instant in time. 

(ii) The thermal capacitance of room walls, 
floor, ceiling, and window is neglected, as well as 
that of any furniture within the system. 

(iii) Heat loss through the walls and windows is 
negligible. 

The performance equation of the system proper 
can be obtained by using the continuity law or heat 
balance. For a room, the law states that the flow 
of heat into the system must either be absorbed 
inside the room or leave the room. Referring to 
figure 2, we have 


% 



T 2 , 0 2 T Cl Q z 


Fig. 2. Room heat flow rates . 

[heat in] -[heat out] = [heat accumulation] (I) 

[heat in] = <?,, +<7 i2 +<7di (2) 

[heat out] = q 0 x +q 02 (3) 

[heat accumulation] = q s (4) 

where 

q di = heat disturbance in impulse form in 
kcal s 

q iX = heat flow into the system proper by cir- 
culation air in keal/s 

q i2 = heat flow into the system proper by fresh 
airinkcal/s 

q 0i = heat flow out of the system proper by 
circulation air in keal/s 

q 02 = heat flow out of the system proper by 
c hausted airinkcal/s 

q s = rate of heat stored inside the system pro- 
per in keal/s 

Whenever the unit system is needed the mks 
system is used in this study. Inserting equations 
(2), (3) i (4) into equation ( 1 ) gives 

fal»+<fl2+fcll-faoi+<7o2] = 0. (5) 

Based on the assumption of perfect mixing, the 
expressions for q ti , q n , q 0 , , q 01 and q dl are 


0u — Q\pC,(t ( — 1 0 ) 
= Qtpc,r, 

(6) 

0/2 = QipCfUi-l,) 

* QiPC'T* 

(7) 

0oi * QtpC/(t c — t t ) 

“ Q ipc,T c 

(8) 

002 * QlpC/.l c ~ f m) 
- QiPC'T' 

(9) 

- v>pc,(t d -t.m) 

- ViPC'TA*) 



Note that here the disturbance is considered to be 
an impulse form. This disturbance term will appear 
as a forcing function which can be generally 
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designated as ij>(y) in the resulting differential 
equation. can be written as 

= A/^(a) 

where 

Mi = Vx pC p T d 

Also note that d(y) has a unit of sec *. The rate at 
which heat energy is stored in the system proper 
can be expressed as 

’ da 


9s = Vxl>C, 


- V*(>C P 


d T c 
da 


(ID 


where 

C n = specific heat of air in kcal kg C 
Q x = air flow rate by circulation in m 3 s 
Q 2 = flow rate of fresh air in m 3 * 

V x = room volume in m 3 

t a = reference temperature in C (In general 
this can be any arbitrarily and suitably 
fixed temperature) 

l c = room temperature in C 
t d = disturbance temperature in C 

= temperature of the circulation air into the 
system proper in °C 

t 2 = outside air temperature in °C 
T c = (r c -/ a )in°C 

r,-(f,-Oin°C 
T 7 = (/ 2 -/ a )in 0 C 
Trf — (^“*0 iit °C 
a = time ins 
p * air density in kg/m 3 

The insertion of equations (6) through (11) into 
equation (5) yields 

v ' pc "l£ + l0.pc (> +c J pC,ir c 

**QipC p T i + Q ipC p T 2 4- V x pC,Tjm 

Q , , Q 2 , p, C p , V, , and T* are considered as 
constants here. The above equation can be simpli- 
fied by dividing both sides of the equation by 
(QipC p +QipC p ) * (Qi + Qi)pC p 

d n 


1 1 +T C — r t T l +r 1 T 1 +T l T J 8(x) 

T c - - 0 at a m 0“ (time 

immediately before introduction of 
the disturbance, i.e time right before 
a -> 0) 


> ( 12 ) 


(Note that in order to have this initial condition, 
the room temperature, before introduction of the 
disturbance is taken to be the reference temperature. 
t a , because T t = I, — I u . ) 

or in dimensionless form 


dx ! + V| _ [ i A |A 2 + , ,A| + A'|ff.i(r) I 


dr 


K, 


.v, =0 at r = 0 


I2)a 


where 


•v, = 


Qx + Qi 

Qi 

e.+<?2 

= A, T. 

T.o 

: T: 


= U-r,) 


v, = 


7\ 

A 4 r, 


('.<>- O 


T d 






T 2 (t 2 ~ { a ) 

I = x t | = dimensionless time 


A, = -L - 


(h~t u ) 


T c 0 (1,-o-U 

K = — = {hzlsl 

T,0 Ui0~ O 

r , = time constant of the system proper in s 
Vx 

Q \-<-Qi 

T c0 = room temperature at a = 0 + 

T c 0 - - room (system proper) temperature at 
a = 0“ 

T, 0 = temperature of the circulation air into the 
system proper at a = 0 + 

Equation (12a) is the performance equation of the 
system proper. This performance equation can 
appear in another form in which the effect of the 
disturbance is taken into account in the initial 
condition immediately after the onset of the process 
as shown below: 


dx, 

df 

*i * 


+*i 


at 


*4 

I « 0 + 


+r j A, 


This initial condition is true because t c - at 
t - 0 + and therefore, 




(W.) _ (U-0 

('co-O " ('c#-'.) 


1 atf »(>♦. 


s 
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Instead of the impulse form, the heat disturbance 
may appear in other forms, such as the step, ramp 
or cyclic functions. The disturbance arises from 
various sources, such as sun load, turning on lights, 
opening window or door, temperature change in 
the incoming air, and heat generated by the 
people or animals. 

If the temperature of the incoming recycle air, 
T, , is kept constant, changing air flow rate may also 
accomplish the purpose of control. The perfor- 
mance equation for such a case can also be derived 
similarly from equation (5). 

Note that if Q 2 = 0 or r 2 = 0, r x is unity and 
equation (12) becomes 

T,^ r +7V = (13) 

da 

This equation is applicable to underground shelters, 
space crafts and submarines under conditions 
where no fresh air enters the systems. 

B. The control element 

The heat exchanger which is the control element 
of the system under consideration can perform its 
control function in various ways, for example, by 
changing the temperature or flow rate of the heat 
transfer medium, or changing both. The perfor- 
mance equation of the control element can be 
obtained again by employing the continuity law 
or heat balance, which can be expressed in equation 
form as follows: 

[heat in] -[heat out] = [heat accumulation] (14) 
[heat in] = q mil +q ml 2 
[heat out] = q m0i +q m oi 

[heat accumulation] = q m , 
where 

q m n “ heat brought into the heat exchanger 
by circulation air in keal/s 

q m ii = heat brought into the heat exchanger 
by cooling water in keal/s 

q m o, « heat flow out of the heat exchanger 
circulation air in keal/s 

q m 02 - heat flow out of the heat exchanger 
cooling water in keal/s 

q m , = heat stortd in the heat exchanger in 
keal/s 

Inserting these definitions into equation (14) gives 

(««,!! +9».I2)-(«»OI+«.Oj) - qm (15) 

By assuming perfect mixing of both air and the 
heat transfer medium in the heat exchanger, 
ignoring the heat lots through the shell and neglec- 
ting the thermal capacitance of the heat exc h ange r , 


<)i 


ihe expressions for q mi , . q mi2 , </ m0 , , and q m „ 2 are 
as follows : 

<l»n * QiPC r (t c -t a ) 

« QxPC p T c (16) 

tfmil 2=1 ~~ 

= Q*(> W C PW T WI (11) 

QmOl “ Q \pCpUi~ t a) 

= 9\pC p Ti (18) 

tfm02 ^fl) 

= Q w P w C pw T wh (19) 

The rate at which heat energy is stored in the heat 
exchanger can be exnressed as 

d it 

Pms = VtfCp ^ 


= VipCp 


da 


- y * C '%t (20) 

da 

where 

C pw = specific heat of coolant in kcal kg’C 
Q w = flow rate of coolant in m 3 s 
t we — inlet temperature of coolant in °C 
t wk = outlet temperature of coolant in °C 

V 2 = volume of the heat exchanger occupied 
by air inm 3 

p w = density of coolant in kg/m 3 

Insertion of equations (t6) through (20) into 
equation (IS) gives 

(QipC p T c + QwPwC^T^) - (£? \pC p T i 

d T t 

+ QwPwC pwT wk) *" ^ 2pC p 

or dividing by Q x pC r 

d^ _ ~ T wc ) .... 

"T*+ TimT ~ Q>pc, {2l) 

where r 2 is the mean resident time of air in (the 
time constant with respect to air flow of) the heat 
exchanger in seconds and is defined by 

tj * 

Note that is the amount of 

heat removed from or added to the system which 
can be controlled by adjusting either Q w when p v , 
C^, and (r„-r w ) are constant, or 
when Q w , p„, and C^, are kept constant, or both 
Q w and when p w and are constant 

In older to have a mathematically neat form, a 
hypothetical temperature T, is defined as 

T f ■ QwPwCfJJvk—Ty")! Q \pCp 
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Inserting this definition into equation (2! ) yields 




(22) 


or in dimensionless form 


T2d '’ 2 +.v 2 = -K a (K 2 0 + K } ) (22a) 


r | dr 


*1 


where 


K 2 = — (T, mil -T rmin ) 
2 


A 3 — . {T r m!ls *+■ T r m j n ) 
i 


0 = 


T, — \(T r mj , + T r min ) 


r flu* 2^^ r max 4" min^ 

= control variable 


J = /fjO + A-j 
Ti 

Equation (22) is the performance equation of the 
heat exchanger which is shown schematically in 
figure 3. Note that 0 = + 1 when T r = T, „„ and 
0j= - I when T r = T rmm . 

T «. o. 

J*U 



Fig. 3 . Schematic diagram of the heat exchanger. 


C. The feedback element-thermostat 
Here we simply assume that the sensing element 
measures the room temperature instantaneously 
and that there is no accumulation of heat in the 
element, or for simplicity, it will be assumed that 
the sensing element is the zero order element with 
its time constant, t 3 , equal to zero. Reference 23 
gives a detailed explanation of the response of the 
thermostat. 


SIMULATION 

With the model in hand, a simulation should be 
carried out extensively by means of either a digital 
or analog computer. The results of simulation 
should then be compared to the known characteri- 
stics of the system or to experimentally obtained 
data. The comparison enables us to determine the 
goodness of the model as an approximate repre- 
sentation of the system. 

For illustration, let us consider a simple system 
in which the time constant of the heat exchanger is 


negligibly small, i.e., z 2 -» 0. For this system we 
have from equation (22) 

T, = T C -T r (23) 

This relation can also be obtained by simple 
(steady-state) heat balance around the heat 
exchanger. Note that T, is positive whenever heat 
is removed from the system and negative when 
heat is added. Inserting equation (23) into equation 
(1 2) gives 

d T 

Tj ~ +r 2 T c = r 2 T 2 + x t TJ(*)-r l T r 
da 

T c = T c0 _ = 0 at a = 0~ (24) 

Again note that the room temperature before 
introduction of the disturbance is taken to be the 
reference temperature. As mentioned previously 
this set of equations can be rewritten to give 

d T 

t, -j^ +r 2 T c = r 1 T 1 -r x T, 

T c = T c0 = T, at a = 0 + (24a) 


Steady state Value of T, before Disturbance, T r 0- 
The steady state value of T, before disturbance, 
T, o- , can be evaluated by inserting 

r r *0,r, -0, and ~ = 0 
da 

into equation (24). This gives rise to 

T f0 . * — , r t *0 (25) 

r t 


Note that the steady state value of T r which is 
denoted by T r0 is zero when the outside air tem- 
perature, 7*2, is zero, or when the ratio of the fresh 
air to the total air is zero. This solution can also be 
obtained by either over-all heat balance around the 
system or heat balances around the room and the 
heat exchanger. 

t 

(I) Over-ail heat balance around the system 
(figured) s 


0 . FC,T, 


f 

j HfOt 
| Eachongcr 


T. 


— i^r - " "■ 


0 t ^C,T f 

o//*C,T 


to.+o,)^ 


Flg.4. Overall heat bekmet of the system with r - U. 
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QipC'T^Q^pC^ + QipC'T') = 0 
Therefore, 

r ,„. ( 25 .) 


Q i r , 

Recall that T c equals zero. 

(2) Heat balances around the room and the 
heat exchanger 

{QipC,Ti+Q 2 pC p T 2 ) = 0 
and 

Q t pC p Ti+ Q x pC p T r = 0 
Solving for 7 r0 from these equations, we obtain 


r,T 


2 * 2 


Tr = r r0 - = - r , = - 


The final steady state value of T fS T r/ 

The final steady state value of T r , which is 
denoted by T r/f can be obtained by letting 

AT 

T c = 0 and -~ = 0 
da 

in equation (24). Hence 

r rf = — (t,r^j)+r 2 r 2 ] 
r 1 

Initial value of T c 

The initial value of T c at t = 0 + can be calculated 
by the following relation representing the heat 
balance between the condition before and that after 
the disturbance. 


or 


V x pC,T c0 * V x pC,T d 
T c o * T d 


(26) 


The desired final value of T r is zero. Meanwhile, 
the lower bound of T f , T r is set at 0°C. Various 
cases with different upper bounds of T r > T rfM%% 
will be simulated. 


Therefore 


and 


A t — T i0 — T z + 


rje 


- -exp^- ~ )l' r . * 0 (27) 

Note that we can also solve equation (24) by 
means of Laplace transform. Laplace transforma- 
tion of equation (24) gives 


T c (s) = 


r 2 T 2 


rJr 




j(t, s+r 2 ) j(T,r + r 2 ) T,s + r 2 
Inversion of the above equation gives 

T,(x) = r 2 exp^- +r 2 j^l-cxp^- ^ 

which is identical to equation (27) because 
T d as given by equation (26). a, can be found from 
equation (27) by setting T c = 0. 

«/- - - ~ ) . r 2 * 0 (28) 
r 2 \T c of:-T 2 r 2 + rJ r J 

For r 2 * 0 or equivalently r, * 1, equation (24) 
becomes 


= TA*)~ — - 

da r. 


, 1 2 — 0 


Integrating this equation, we have 


T e « - 


■ a 4* 7 t o 


a / can be obtained by setting T c ® 0 as 

^oT i _ 

aj - — , r 2 * 0 

* f mu 


(27a) 


(28a) 


The solution of T c 

Simulation of the desired model can be carried 
out when the form of T, and the numerical values 
of the parameters are known. In case T, is the step 
function, i.e., T, remains constant after a a 0, 
equation (24a) can be integrated as 


7,(«) - exp^- ^ ^ , +r 2 exp 



where A , is an integration constant. The alue of 
^ i can be determined by employing the initial 
condition ata - 0*. that is, 


r e -r t0 nt e-0* 


Numerical examples 

It is assumed that the volume of the system 
proper (room'or cabin), K, , is 

K, ■> 3mx4mx5m 
- 60m 1 

The flow rate of air in the system, 0, is 

0 ■ (cross-sectional area of the ystem)x(air 
velocity in the system) 

« (3mx4mX0*l m/s) 

• 1*2 m */a 

andflow'rates of circulation air and fresh air are 
0, -0*0 - 0*96 m J /s 
0 ,- 0 - 20 - 0-24 m*/» 
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The time constant of the system proper, t , , is 


T. = 


r, 


Q Q1 + Q2 12 

Other numerical values employed are 
T 2 = 10 C 
T t = 20X 
T, ml „ = OX 

r 2 T 2 0-2x10 


60 

= — — 50 s 


T, 0 = 


0-8 


= 2-5X 


Case 2: T r m „ = 30 C 

For this case, we have from equations (27) and 
( 28 ) 


T c = 20 exp ( - 

+ loj"l - exp 

-)1 

\ 

T >/ L V 

T «/J 

1 

! 1- 
X 

0 



r i L 

\ './J 


*/ = — — Jn I 


Or,-r 2 

f r 2 1 

va + 3r,y r 2 \ 

('a + 3r i. 

ifr 2 # 0,and 




Here two examples with different heat removing 
(or control) capacities of the heat exchanger are 
considered. The first example is for the case in 
which the maximum load (heat removing capacity) 
of the heat exchanger, T, „„ is set equal to 2-5X. 
The second example is for the case in which the 
maximum load of the heat exchanger, T, m „, is set 
to be 30X. 

Case 1 : T, = 2-5 C 

For this case, we have, from equations (27) and 
(28), 

-■SM-sS 



if r 2 # 0,and 

r t ( a) « 20- a/20 
a, - 400 

iff, - 0. 


The results of simulation are shown schematically 
in figure 5. 



fig, 5. Jtwwfr of ttmlnha of s pu rt* (27) *M 
7j- W CmfTtmJBTC. 


T c = 20-0-6a 
z } « 33-3 sec. 


if r 2 * 0. The results of simulation are shown 
schematically in figure 3. 

Similarly, we can carry out the simulation by 
employing the dimensionless form of the perfor- 
mance equation. The performance equation in 
d'mensionless form can be obtained by combining 
.■quations (12a) and (22a) and setting t 2 - Oas 

d.v, 

— 4-rjjr, =r 2 /f, +A l o6(t)—r l K l K 2 0—r l K l K i 

(29) 

Boundary conditions are 


-v, ■ 0 at t 0- 
.v, - 0 at t « T 


As mentioned previo ' h;.* set of equations can 

also be written as 

dx, 

-h.-jx, « ^K.v.o rjAjAj 


x, - 1 at (- (29a) 
x, ■ 0 at 1 - 1 

First of all, let us assume 0 is a given control 
action and is equal to 0 m - I. Then equation 
(29a) can be integrated as follows: 

x,(f) - exp(-r 2 /)^ 2 -»-A, exp (r 2 i) 

— «P('a0- exp(iy) I 

r jt*0 

Application of the boundary condition, x, » 1 
atr - 0 % yields 



and 
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-v ,(/) = exp( -r 2 /) + A',[l -exp ( -r : f *] 

r i^ 1 k 2fi g >k1 r i A , Ky 
[! —exp (-r 2 0] 


[I -exp <-r 2 /)], r 2 # 0 


(30) 


Final time, 7, corresponding to the end of control* 
can be obtained by using the condition 

v t — 0 at t ~ T 

This yields 

j __ ]_ * / r \K\K 2 +r\K\K)-r2K\ \ 

r 2 \r 2 - r 2 K x f ri K t K 2 + r l K l K y ) ’ 

r 2 * 0 (31) 

r roxr 2 = 0, equation (29) becomes 

or in integrated form 

.v,(l)= -*,(*, +*,)/+ 1, r 2 =0 (30a) 

T can be obtained by employing 

Xj = 0 at I = 7" 

This gives 




(31a) 


Two examples which correspond to the problems 
solved in dimensional form are considered here. 

Casel :T fm ., - 2-5‘C 

For this case, we have, from the definitions of 
Ky and Ky and equations (30) and (31), 

Ki - - 55 (2-5-0) - 0-123 

Ky - 55 r (T rmn + T, m J - 55 ( 2 - 5 + 0 ) - 0-125 
Jr t (r) - exp(-r,l)+0-5|i-exp(-r,r)J 


0-125r 


ifl-expf-rjOJ.r, ft 0 


1 rOI25r ( -0-5r,1 


v,(/> = -0-I25/+I, f 2 — 0 

I 


T a- 


r, - 0 


0*125' 

The results of simulation are shown in figure 6. 
Case 2 :T rmjx = 30 C 
For this case, wc have 

*2 = " 5j (30-0) = 15 

*3 = ^riT rm » + T rmin ) = ^(30 + 0) = 1-5 


27% 


20 


.v,(r) = exp(-r 2 /) + 0-5[l -exp(-r 2 f)] 

— 1-5—11 — exp( — r 2 r)J, r !f t0 

r i 

I l-5r|— 0-5fj . 

T In 2 , r 2 # 0 

r 2 0-5r 2 + l-5r| 

.x,(r) = - l-5f+ I, r 2 = 0 


T =± 

1-5’ 


r 2 — 0 



Fig. 6 . Result of simulation of equation (30) with 

t, - io°c wij r, - wc. 


The results of simulation are shown in figure 6 
and tabulated in Tabk 1. 

Note that the numerical examples are restricted 
to the cooling problems for simplicity. However, 


Table 1. Sbuulatk m tenths Joe iuq su bt heal Sttm bau e e . 


dl 


f I 

ft 

T,mm - 
«/<fKe) 

T.^mWC 0-123 

Mm» r 


1 

0 

400 

351 • 

046 

0*8 

M 

00 

41*1 oo 

0*84 

0 

1 

00 

00 00 

00 
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the performance equations developed here can be 
applied to the case in which air is heated in the 
heat exchanger, i.e., T, is negative. In other words, 
the performance equations can take into account 
both heating and cooling actions of the heat 
exchanger. 

GENERAL SYSTEM EQUATIONS 

In th; preceding section, the performance 
equations have been derived for the case* m which 
the disturbance is of the form of the impulse 
function and air in the cabin or room is completely 
mixed. However, the procedure for deriving the 
performance equations is fairly general and can be 
extended to cases in which the disturbances arc of 
the form other than the impulse function and air 
in the room or cabin is far from being completely 
mixed. 

First, let us consider the case resulting from step 
heat disturbance while ot>..r conditions remain 
unchanged from those considered in the preceding 
section. The heat disturbance has the form 


Qe, « (Qt + Qi)pC,T 4 V 0 (*) 

(32) 

The performance equation, for the system proper 
can be obtained as 

+7V - r,T,+r 3 T 2 + T t U 0 (*) 

(33) 

or in dimensionless form 


~~ +*, - +r 2 K t + K t oU 0 (» 

Uf A 4 

(33a) 

Similarly, for the system with ratnp heat distur- 
bance, we have 

- ~ pC'T.m 

(34) 

T, ’d« +7V " ,7 ‘ ,+,,7 ‘ ,+ ^ 

(35) 


and 


dv, r,A', a, 

-77 +-v, = — — - +r 2 A A,<7fl</) (35a) 
d t K 4 

In general, the dimens»onles> perf ' ' » icc equation 
for the system element can be written as 

dv. r.A,.v, 

^ +.v, - — — + r 2 K x +K ] aF [ t) (36) 


where F(t) stands for the functional form of the 
heat disturbance which can be impulse function 
<>(/), unit step function ramp function R{t) 
(or /£/(/)], cyclic disturbance or any other Jistur- 
bance. This equation together with equation (22a) 
form the complete dimensionless system equations, 
that is, 

d-V, r,A|.v, 

+ *• - + '2*. ±K x aF(t) (36) 


1 

r, d t 




-KJKJ+K,) 


(22a) 


It is worth noting that the initial condition for 7", is 
T t = T c0 - - Trf = 0 at a = 0' and 0 + 
and the initial condition for .v, is 

-v, = —— = ~ ■ I at t ■ 0- and 0 + 

• ,o • <o 

(Note that for the heat disturbance represented by 
the unit step or a higher order function. T 0 .. the 
T t before introduction of the disturbance is identical 
to r.o, the T t immediately after introduction of the 
disturbance. The value of T t 0 or T l0 can be zero 
if the reference temperature t a is taken to be i, 0 . , the 
room t-mperatuio before introduction of the distur- 
bance as done in the case of the impulse input* 
however, this ihould be avoided because of the 
definition of K u (t 2 - /.)/(/, 0 *~ O. which is 
employed in developing dimensionless forms of the 
systems equations. If t m - r (0 , K x approaches «. 
which should be avoided). The performance 
equations for various types of heat disturbances 
are tabulated in Table 2. 


Table 2. The performance tqmtio* Jor system element. 


Type of heat The Jimemionft** Initial condition 

disturbances performance equation* of T 


Hr , f.Jf, 

Impulse* 4«) -rj- +x t - ■—■x t ^r 2 K t ^K i avU) 0 

*4 



or 

or 


4*1 . . ► 

I 

Step VU) 

"j" 1 +Jt * " + 

1 

RanpiKO 

^ +*» “ 

I 

Central ft') 

it + *» • i? *»+»■*** +*»•«'> 

1 
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PERFORMANCE EQLATiONS FOR 
TWO COMPARTMENTS MODEL 


Next, let us consider the case in which air in the 
room or cabin is no longer in the state of complete 
mixing. Specifically, we shall consider the case in 
which flow of air in the room can be characterized 
by two completely stirred tanks (or pools or com- 
partments)in-series model (2 CSTs-in-series model). 

The following assumptions must be added to 
t e already made for the system proper in the 
preceding section: 

(a) The room is divided into two well mixed 
compartments in series. Volume of each pool is 
denoted by V xx and V x2 , and the temperature in 
each pool is denoted by T c , and T cl . 

(b) Backflow of air from the second compart- 
ment to the first compartment is negligible. 

(c) Disturbances are equally distributed over the 
system. 

(d) Fresh air comes into the first compartment 
at a constant flow rate, while exhaust air is released 
from the second compartment at a constant flow 
rate. The schematic diagram of the system is shown 
in figure 7. The performance equation for each 


Qi 

T, 




r “ 

i 

** r “ 


-1 

! Pool 1 

i 

i 

Pool 2 

1 

1 

i v„ 

i 

i 

V, 2 

1 

1 

1 

i 1ci 

i 

i 

Tea 

1 

1 



_ 

_ -1 

q 2 , t 2 



T 

o 2 . 


0 

T, 


Fig, 7. Schematic expression of a room represented by 
the two CST's-in*series model . 


pool can be obtained by using the transient heat 
balance around each compartment. Thus, for 
pool 1, 


t m ^ + T ci — r x T- t + r 2 T 2 
T cX = 7^10 at t = 0 

where t M is the time constant of pool 1 and is 
defined by 

V , . 

7,1= 

Q 1 + Q 2 

Note that 

Vu = I 'uHQi + Qt) = in 
Vx VxHQx + Qi) t, 

Similarly, for pool 2 we h?.ve 
HQi+Qi'iT tI pc,+ T d my l2P c p ) 

d T , 

~(Q . + Q 2 )p€ p T c , = V , lP C„ (40) 


Again dividing this equation by pC^Qt + Qj) 
yields 

t,i -Zr+ T e2 m T el +^x lz TA*) (41) 

T | 


T c2 = 0 at a = O' 


or 


- +t - T 

M 2 ^ * c 2 - / cl 


T c2 — T ci0 at a — 0 + 

where t !2 is the time constant of pool 2 and is 
defined by 

Vu 


T 1 1 = 


Q , + Qi 


For the heat exchanger, we have from equation 

( 22 ) 

Tj S + 7 ' = 7Vj ~ 7; m 


[heat in] - [heat out) = [heat accumulation] (37) 


or 

[Q i T l pC p +Q i T 1 pC f + ZuTA*)V tt pCJ 

-((?, + Qi)T cl pC„ - V, tP C, ^ (38) 

Dividing this equation by pCJQ t + Q 2 ) yields 

tu^+n. - r l r,+r i T t + hit „!/(«) 

(39 


or 


T ti • 0 at a - 0 


Equations (39), (41) and (42) are the performance 
equations of the system. We may rewrite these in 
dimensionless form by defining 

Tet XjtTcx r Ti 

*11 “ t ■ T * A n “ t 

r c io M i 1 icO 


*11 


KxJci 

r, 2 „“ r, ’ 


*ta 




t - 


« 

ti 
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Introducing these definitions into equations (39), 
(41) and (42), we have 

— ^ + r ll V U = ) 

dr 

(43) 

+ r 12 A 12 = *21- V l! + a 23<K*) (44) 

d t 

d v 

, - +r.v 2 = * 42 * i 2 ~ Oj0— a 6 (45) 

dr 

where 

<j,i = r,A, ,/A 4 
*12 = ''l i r 2^i i 


NOMENCLATURE 

a 5 tK 2 A 4 

a b rA 3 A 4 

*1 1 r l-^l l r l l/A 4 

*12 r l r 2^1 1 

*13 T d Ki ilT 2 ri i 

a 2l r 12^l2/A|| 

*23 TjA, 2-T~2 r \ 2 

*42 '* 4 /*12 

4, Integration constant 

A 2 1 ntegration constant 


*u = F^A, l iT 1 r , i 
*21 = r 12A12/A1 1 

*23 = 7 4 Ai 2 /7'2r,2 

*42 = rA 4 /A, 2 
05 = rA 2 A 4 
* 6 = rAjA 4 



r 12 




*12 


*2 

The performance equations derived in this 
section can also be used for simulation either on a 
digital or on an analog computer by following the 
procedure presented in the preceding section. For 
any given forms of the air flow model and heat 
disturbance, the forms of the dimensional systems 
equations, which essentially represent heat balances 
arc fixed; however, these can be transformed into 
a variety of dimensionless forms and the forms 
given here are not necessarily the most convenient 
ones. 


F(t) 

A, 

A 2 

A 3 

A* 

A u 


Specific heat of air in kcal/kg c C 

Specific heat of coolant in kcal/kg°C 

Functional form of heat disturbance de- 
fined in equation (36) 

h 

T c0 

7JT (T'r mu F r min) 

2 


iTr mu 4" T r m i n ) 

2 

II 

T \ 10 

h. 

Tuo 



V\pc,T t 

q dl Heat disturbance rate in impulse form in 
kcal/.ec 

q u Heat disturbance rate in step keal/s 

q n Heat flow into the system proper by 
circulation air in keal/s 


CONCLUSION 

Methodology and procedure used in this part can 
also be employed for constructing and simulating 
models for other systems in which mass and 
momentum transfer and chemical reactions are 
involved in addition to heat transfer. The perfor- 
mance equations derived in this part will be em- 
ployed in the succeeding part of this series to 
determine the optimal control policy based on the 
modern optimal control theory. 


q,2 Heat flow into the system proper by f resh 
airinkcal/s 

q mn Heat brought into the heat exchanger by 
circulation air in keal/s 

q mll Heat brought into the heat exchanger by 
cooling water in keal/s 

q m0t Heat flow out of the heat exchanger with 
circulation air in keal/s 

q m02 Heat flow out of the heat exchanger by 
cooling water in keal/s 


€ 
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q ms Heat stored in the heat exchanger in 
kcal s 

</ 0 , heat flow out of the system proper by 
circulation air in kcal s 

(f 02 Heat flow out of the system proper by 
fresh air in kcal s 

Q Q\ + Qii flow rate of air in the system 
proper in m 3 s 

Q { Air flow rate by circulation air in m 3 s 

Q 2 Flow rate of fresh air in m 3 s 

Q w Flow rate of coolant in m 3 s 

r r, r 2 , the ratio of time constant of system 
proper to that of heat exchanger 

r, — — , the fraction of circulation air 

Qi + Qi 

Q, 

r , — — , the fraction of fresh air 

Qi + Q 2 



R(t) Ramp heat disturbance function 

a 

t — , dimensionless time 

T| 

Reference temperature in °C 
t c Room temperature in °C 

t d Disturbance temperature in °C 

/i Temperature of incoming circulation air 

in°C 

t wc Inlet temperature of coolant in °C 
/„.* Outlet temperature of coolant in X 

1 2 Outside air temperature in X 

T Final time, dimensionless 

T e (t e - /,), room temperature in °C 

T'{s) Laplace transform of T e (x) 

T t o Room temperature at a = 0 + in X 

T tX Temperature of pool I in °C 

T c io Temperature of pool I at a - 0 + in °C 

Temperature of pool 2 in °C 
r, 20 Temperature of pool 2 at a « 0 + 

T t (it ~ I,), disturbance temperature in °C 

T, (t t temperature of the circulation air 
into the system, in °C 

T,o Temperature of the circulation air into the 
system ata « 0 + in°C 

T QwPwCgJJ'wt ~ T^) hypothetica , temper8 . 

turn 


Tr, 

Final steady state value of T r 

T 

J r mai 

Upper bourd of T r \n C 

T 

M r min 

Lower bound of T r in C 

T r0 

Value of T r at i — O’in C 

T vc 

/ Hr --f c in C 

T wh 

t wh ~t a in C 


Temperature of pool 1 in C 

t 12 

Temperature of pool 2 in C 

V a (t) 

Step heat disturbance function 

1 

Volume of room in m 3 

V,, 

Volume of pool 1 of two completely stirred 
tanks in series model in m 3 

Vi 

Volume of heat exchanger in m 3 

y,2 

Volume of pool 2 of two completely stirred 
tanks in series model in m 3 

X,(t) 

T 

zr~ , dimensionless room temperature 

T rO 


T- 

— » dimensionless temperature of the 
i0 circulation air 

•V, , 

T 

, dimensionless temperature of pool I 

* c 10 

*12 

T 

— — , dimensionless temperature of pool 2 

Tf 20 


Greek letters 
at Time in sec 

ct f Final time in sec 

<5(a) 1 vupulse heat disturbance function, s" 1 

p Air density in kg/m 3 

p w Density of coolant in kg/m 3 

T 

tr — , dimensionless disturbance temperature 

y 

t , — — x — - , time constant of the system proper 

Qi + Qi ins 

y 

t,, — — .time constant of pool 1 ins 

' Qi + Qt 

y 

t 2 — , time constant of heat exchanger ins 

Ci 

y 

r ,2 ’q~+q~' t'me constant of pool 2 ins 

0 — — — JT ' 1 3 , . control variable 

T, m -¥T, W +T rmi ,) 

1+1 at r, ■ T rmu 
\-l at T, m 

^(a) Heat disturbance function 
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Plusieurs modeles methematiques d'un systeme dc controle environnant consistant 
d'un espace ou d'une cabine limites, d'un echangeur dc chaieur et d'un element de 
retroaction tel qu'un ihermostat, sont presentes. Les equations de performance du 
systeme qui representent les caracteristiques dynamiques du systeme lui-meme et de 
Pechangeur de chaieur (L'element de controle du systeme) sont derives. Dans le 
modele fondamental, 1* courant d'air dans Pespace limite est considere etre dans 
Petat de melange complet et la perturbation est due a une entree de chaieur par impul- 
sion. Les equations de performance, dans iesquelles les perturbations de cha : eur sont 
d'une forme telle que la fonction d'etape et la function cyclique qui sont d*lTerentes 
de la fonction d'impulsion, sont egalement derivees. On presente egaiement les 
equations de performance qui representent les caracteristiques dynamiques d'un 
courant d'air dans un espace ou une cabine limites caracterises par les deux modeles 
de vaisseaux en serie complement agites (2 CST en serie). 

Afiti de determiner la valour du modclc, on utilise une simulation par ordinateur 
et les resultats sont compares aux caracteristiques connues du systeme. 


Mehwre mathematische Modelle eines Umgebungs-Kontrollsystems, das aus einem 
begrenzten Raum oder Kabine, einem Warmetauscher und einem Ruckwirkungs- 
element, wie z.B. einem Thermostaten besteht, wurden dargestellt. Die Leistungs- 
gleicfiungtn des Systems, welche die dynamischen Eigenschaften des eigentlichen 
Systems und des Warmeaustauschers (dem Kontrollclcment des Systems) darstellen, 
werden abgeleitet, In dem grundlegenden Modell wird der Luftstrom in dem begrenz- 
ten Raum als grundlich gemischt angesehen und die Beurruhigung wird durch 
einen zugefuhrten Warmeimpuls verursacht. Die Leistungsgleic ungen, in welchen 
die Warmestdrungen in der Art wie die Stufenfunktion und zyklische Funktion sind, 
welche anders als die Impulsfunktion sind, werden ebenfalls abgeleitet. Es werden 
ausserdem die Leistungsgleichungen dargestellt, welche die dynamischen Eigenschaften 
der Luftstrdmung in einem begrenzten Raum oder Kabine wiedergeben, was mit dem 
Model! von zwei vdilig aufgeruhrten Reihentanks (2 CST's-ir-series) geschildert wird. 

Eine Komputer Nachahmung wird durchgefiihrt, urn die Gute des Systemmodells 
zu ermitteln, und die Ergebnisse werden mit den bekannten Eigenschaften des 
Systems verglichen. 
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Application of Modern Optimal Control 
Theory to Environmental Control of 
Confined Spaces and Life Support Systems' 

Part 2 — Basic Computational Algorithm of Pontryagin’s 
Maximum Principle and its Applications 

L. T. FANt 
Y. S. HWANGf 
C L. HWANGf 

The basic form of Pontryagin's maximum principle which is a keystone of the 
modern optimal cunttul theory is presented. The principle is applied to the 
determination of optimal control policies of several life support or environmental 
control systems. 

Three concrete examples all of which are concerned with the temperature 
control of a life support system consisting of an air-conditioned cabin ( the 
system proper) subject to an impulse heat disturbance and of a heat exchanger 
(the control element) are considered . The first example treats the case in which 
the time constant of the heat exchanger is negligible. The second example 
considers the case in which the time constant of the heat exchanger is not 
ignored . In the third example the optimal policy of the system where the flow 
of air in the cabin can be characterized by the two completely stirred tanks-in - 
series (2 CST's-in-series) model is studied . In this example , the time constant of 
the heat exchanger is again neglected. Procedures and computational approaches 
employed for obtaining the optimal control policies are given in detail. 


INTRODUCTION 

MATHEMATICAL models of air-conditioned 
rooms or cabins or life support systems have been 
established in the preceding article[!]. In this and 
two of the succeeding articles, the various forms of 
Pontryagin’s maximum principle[2-8] will be 
introduced and will be used to determine the 
optimal control policies for such systems. 

Use of the maximum principle almost always 
gives rise to a two-point split boundary value 
problem, the solution of which will be further 
elaborated. Even though this principle leads to 
two-point boundary value problems which are 
often difficult to solve, it still provides a practical 
approach to process systems optimization. 

Another difficulty also arises in using the maxi- 
mum principle formulation as the basis for com- 
puting optimal control. The maximum principle 
generally provides only the necessary condition 
but not the sufficient condition which must be 
satisfied by the optimal control. 

* This work was supported by the Air Force Office of 
Scientific Research, Office of Aerospace Research, United 
States Air Force, Under Contract F 44620-68-0020 (Themis 
Project), and NASA Grant Under Contract NGR-17- 
001-034. 

t Institute of systems design and optimization, Kansas 
State Unive.aity, Manhattan, Kansas. 


In this particular article the most basic form of 
Pontryagin’s maximum principle will be stated and 
it will then be used for determining optimal 
operating policies of the life support or environ- 
mental control systems which were described in 
Part 1 of this series[lj. 

STATEMENT OF ALGORITHM 

Consider that the dynamic behavior of a con- 
trolled system can be represented by a set of 
differential equations 

= /.(*«('). xJLOiW), -.0X0], 

at 

i - 1, 2 r (1) 

h ST 

or in vector form 

toZtST (la) 

where x(r) is an s-dimensional vector function 

representing the state of the process at time t 
and 0(0 is an r-dimensional vector function re- 
presenting the decision at time ([2, 3]. The functions 
/,, /«■ 1, 2, .... s, are single valued, bounded, 


JRBCflpWg PAGE blank NOT filmed 
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differentiable with respect to the with bounded 
first partial derivatives, and are continuous in the 
O ' s on a product region .\*0, where .v and 0 are closed 
regions in the 5-dimensional .v-space and r-dimen- 
siona! 0-$pacc respectively^]. Note that we are 
dealing with the autonomous systems in which the 
right-hand side of the performance equation, 
equation (1), depends implicitly on time /. The non- 
autonomous systems a r e those in which the right- 
hand side of the performance equation, equation 
( I ), depends explicitly on time t. 

A typical optimization problem associated with 
such a process is to find a piecewise continuous 
decision vector function, 0(f) subject to the p - 
dimensional constraints 

mt)]g o, / = 1,2, p ( 2 ) 

such that the performance index 

5 = Z <V v i(n, c , = constant (3) 

t- 1 

is minimum (or maximum) when the initial condi- 
tions 


v ,('o) = *,o, / = 1 , 2, . . . , 5 (4) 


are given. The duration of control. T> is specified 
and the final conditions of state variables are 
unfixed. This type of problem is often called the 
free right-end problem (with fixed T). The decision 
vector (or a collection of control variables) so 
chosen is called an optimal decision vector (or 
optimal control variables) and is denoted by 0(f). 

The procedure for solving the problem is to 
introduce an s-dimensional adjoint vector z(t) and a 
Hamiltonian function which satisfy the following 
relations 


JfMf), 0(f), z(t)] = £ zMttxOl 0(f)] 


I“1 


d z_ dJf _ _ ’ 

d / dXf f? y Zj dx t ' 


1 , 2 , 


h(T) = r lt 


i « 1,2,... 


s 

s 


(5) 

( 6 ) 

(7) 


The set of equations, equations (1), (4), (6) and 
(7), constitutes a two-point split boundary value 
problem, whose sofution depends on 0(f). The 
optimal decision vector 0(f) which makes 5 an 
extremum also makes the Hamiltonian an extremum 


for all f, i.e., f 0 £ t <. F[2, 3,5,6]. 

A necessary condition for 5 to be an extremum 
with respect to 0(f) is 


dJf 

d0] 


* 0, 


/- U 2, ..., r 


( 8 ) 


if the optimal decision vector is interior to the set 
of admissible decision 0(f) [the set given by equation 
(?.)]. If 0(f) is constrained, the optimal decision 
vector 0(f) is determined either by solving equation 


(8) for 0(f ) or by searching the boundary of the set. 
More specifically the extremum value of Hamil- 
tonian is maximum (or minimum) when the control 
variables are on the constraint boundary. Further- 
more, the extremum value of the Hamiltonian is 
constant at every point of time under the optimal 
condition. It is worth noting that the final condi- 
tions of the adjomt variables. z^T), are often given 
as — c, instead of c, as shown in equation (7), 
in employing the maximum principle of Pontryagin. 
The use of such final conditions of z£t) gives rise to 
the condition that the Hamiltonian is maximum 
when the objective function is minimized, and 
minimum when the objective function is maxi- 
mized as stated in the original version of the 
maximum principle of Pcntryagin[2,3,6]. 

If both the initial and final conditions of state 
variables are given, the problem is said to be a 
boundary value problem. The basic algorithm 
presented except the condition given by equation 
(7) is still applicable[3]. 

If optimization (usually minimization) of time t 
is involved in the objective function in a problem 
with an unfixed duration of control, F, the problem 
is then called a time optimal problem. In this case, 
the basic algorithm presented is still applicable 
with an additional condition that the extremal 
value of the Hamihor.ian is not only a constant 
but also identical to z?;ro. The simplest example of 
the time optimal control problem is one in which 
the performance index is of the form 

T 

S -- } df 

o 

Such a problem is often called a minimum time 
problem. 


EXAMPLES 

The basic form of the maximum principle 
presented in the preceding section will be applied 
to concrete examples. Procedures and computa- 
tional approaches employed will be given in detail. 

Example 1— Suppose that the dynamic behavior 
of a life support system consisting of an air- 
conditioned room or cabin subject to the impulse 
heat disturbance and a heat exchanger with 
negligibly small time constant (t 2 -> 0), can be 
represented by the following equation[l] [equation 
(29a) in Part 1 of this series] : 

+ r z x i ® r x KiK z 0—t \K\Ks (9) 


with 

jr t (0) » 1 at / - 0 + 
Xi (T) « 0 at t m T 
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where T is the unspecified final control time. We 
wish to determine 0 so that the response of the 
system can return to its desired state in a minimum 
period of time, that is to minimize 

T 

S= Jd/ (10) 

» 

If an additional state variable v 2 is introduced as 

.v 2 (0 = ! d/, 

6 

it follows that 

^7=1, -v 2 (0) = 0 (11) 

d/ 


The problem is thus transformed into that of 
minimizingA* 2 (F). 

According to equation (5), the Hamiltonian is 

nm *(/), 0(f)] 


— z | [ — r 2 .v | + r -tK | — r \ K — r \K \ /Cj] + 

( 12 ) 


The components of the adjoint vector, according to 
equation (6), are defined by 


d t 


dJt 

fix , 


= r 2 z x 


~ = - “ = z 2 (T) - I 

dr dx 2 

Solutions of equations ( 1 3) and ( 1 4) are 
z t (r) = A exp (r 2 t) 
z 2 (t) = 1, 


(13) 

(14) 

(15) 

(16) 


where A is the integration constant to be determined 
later. Inserting equation (16) into equation (12) 
yields 

JfP ™ ^ r x K 2 z — r 2 z |*V| + r 2 K jZ | — r j/l, / ijr j 

+ 1 (17) 


Therefore the switching function JF*, the portion of 
Jf which depends on 0, is 

Jf* = -r i K l K 2 z l e (18) 

Recall that minimization of the Hamiltonian with 
respect to 0 corresponds to that of the objective 
function. Equation (18), however, indicates that the 
minimization of the Hamiltonian with respect to 0 
is equivalent to that of the switching function. Thus, 
minimization of the switching function corresponds 
to that of the objective function. Equation (18) also 
indicates that for the switching function to assume 
the minimum value, 0 must assume its minimum 
allowable or its maximum allowable value depen- 
ding on the sign of the coefficient of 0. 


0 = 0 m „ = 1 if ~r ] K\K 2 z l < 0 (19) 

0 = 0mm = - 1 if -r l K t K 1 ; l > 0 

Time optimal contro’ policy of this type is of 
bang-bang type [3, 4, 6, 9]. 

In the case where the coefficient of 0 in equation 
(18) vanishes, we have the possibility of singular 
control[10]. For singular control, the control 
variable takes on values which are intermediate to 
0 ma% and f) min ; hence the name intermediate control 
is also used in place of the singular control[10]. Also 
inertialess control will be considered. An inertialess 
controller has the ability to shift from 0 majl to 0 min 
instantaneously and vice versa. 

The maximum principle now requires that the 
system equations, equations (9) and (11), be 
integrated simultaneously with the adjoint equation 
( 1 3) so that the two-point boundary conditions 

-v,(0)= 1, -v l (D = 0 

v 2 (0) = 0, a* 2 (F) = undetermined 

jj(0) = undetermined, r,(F) = undetermined 

are satisfied. For this minimum time problem 
extremum of the Hamiltonian must vanish at every 
point of its response. 

In order to bring the initial deviated state 
.y,(0 + ) = 1 to the final desired operating state 
.y^F) = 0, we intuitively reject the control 0 = 
0 m j n = - 1 (which corresponds to the minimum 
cooling action). Equation (9) can be integrated 
with the conditions 

o = = 1 (20) 

and 

.v,(0) =1 at / = 0 + (21) 

as 

*,(/) = exp( — r 2 f) + ~ (r 1 K i -r i K l K 2 
r 2 

-r,K,A,)(l-exp[-iy]) 

= exp[-r 2 t] + - (1 — exp[-r 2 /]) (22) 

r i 

where 

ri ** r 1 K l -r l K l K 1 -r l K l K 1 (22a) 

The integration constant A in equation (IS) can 
be determined by using the condition that minimum 
H is zero for all the process time in time optimal 
control. At t «* 0 + , we have from equations (15), 
(17), (20) and (21) 

A « Z|(0 + ) - -f 
1 t~ r i 

and 

*,(/) - — exp (r jt ) (23) 

n-'t 


84 


L. T. Fan , Y. S. Hw ang and C. L. Hwang 


Equation (23) implies that r(/) will not change sign 
since only when t approaches negative 

infinity, or in other words, control will not shift 
from 0 mat to 0 min (or from 0 min to 0 m J. Therefore, 
this problem is a particular case of bang-bang 
control which has the bang part only. The optimal 
control policy starts with T r mjkX and then keeps 
operating at the upper bound of T r until the final 
desired state is reached. The final control time can 
be obtained from equations (17) and (20) together 
with the final condition 

.Y| {T) = 0 at / = T 

as follows 

•^«r 1 (DI-r 2 .Y 1 (r) + i f ] + l =0 
or solving for z,(F) 

= t(T) = — (24) 

n 

Also we have, from equation (23), at; = T 

r,(D = — exp (r 2 T) (25) 

n-r 2 

Solving for T f rom equations (24) and (25) gives 



This solution may be verified by inserting it into 
equation (22) as 

x x (T) 


= exp(-r 2 F) + - {l — exp(r 2 T)} 

r i 

= o 


This indicates that the Hamiltonian is kept at zero 
at every point of its response in this minimum 
time problem. For 

r i * 0*8 Cj ® 0*2 

A, . 0-5 - 1-5 

A, - 1-5 e - 2, 

we have from equations (22), (23) and (26) 

2,(0 - exp(0-2/) - 0-769 e*p(0-2r) (27) 

*,(0 - 6-5 e*p(-0-2r)-5 , 5 (28) 

T - 0-8353 


and from equation (27) 

= ]~ = 0-769 at t = 0 

r, - -pj = 0-909 at l - T 




Fig. 1. Optimal control policy and system response of the 
one CST model Tj = 0 [Example 1). 


Equations (27) and (28) are graphically shown in 
figure 1. The state variable .v, approaches asympto- 
tically to the final state, the control variable 0 
remains at unity until the final state is reached, and 
the adjoint vector increases asymptotically. The 
optimal control can be verified by computing JP 
at an arbitrary point, say 0-5, of the time co- 
ordinate as follows : 

/ - 0-5 

2,(0 » exp(-0-l)l-3 
x,(0« 6.5exp(-0-l)-5-5 
and 

- { -0 ^-5 exp(-0*l)-5-5) (29) 

+0-2x0-5-l-2} + l 

- 0 
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This computation shows that the minimum value of 
# is zero at every point of this continuous process. 

Four cases with different cooling capacities of 
the heat exchangers are considered here. T r nu , 
and T t min take the following values for these four 
cases: 


Case 1 

7 

rni,n 

= 30 C 

T 

1 r nun 

= 0 c 

Case 2 

7 

1 r max 

- 20 C 

T 

9 r n.iti 

= 0 ( 

Case 3 

T 

9 r max 

- 10 C 

7 

9 r nrn 

- 0 c 

Case 4 

T 

r max 

= 5 C 

7 

r mtn 

- 0 c 


The numerical solutions for these cases are obtained 
from equations (22). (23) and (26), and are tabulated 
in Table I. 


We wish to determine the conti* .able 0 so that 
the state variables may be brought from ihe initial 
deviated state [\ t ~ I. v 2 - I, at i 0 * ) to the 
final desired state [\, = 0, \ 2 1] at / 7. in a 

minimum time In other words 

S ---- { d / 

o 

is to be minimized. 

(fan additional state variable \ * is introduced as 

x.d/) - .id/, (33) 

d 

it follows that 


Table ! . Optimal solutions of the one C'ST 
model together with r 2 = 0 [Example 1] 


Case 

Two bounds of 

A\ 

A, 

Final time 7 

number 

control variable 




1 

T r = 30 C 

T r min ~ 0 C 

1 30 

1 50 

0-8353 

'S 

= 20 C 

Tr min — 0C 

1 00 

1 00 

1 2566 

3 

7V m „ = .0 C 

Tr m,n = Or 

0 50 

0 50 

2-5541 

4 

Tr rna. = « C 
Tr min = 0C 

025 

025 

5 493 


Example 2 — Generally, responses of the heat 
exchanger as well as the cabin are not always 
instantaneous. Suppose that for the system con- 
sidered in the first example, the time constant of 
the heat exchanger, t 2 , is not so small as to be 
ignored. The performance equations for such a 
system have been derived in the first part of this 
series of articles [equations ( 1 2a) and (22a) in [1]) . 

^ +.v, = a,.Y 2 +a, (30) 


= 1. v»(0 ' ) - 0 (34) 

dr 

and 

v,(r> ■= j dr = .S' (35) 

I) 

The problem is now transformed into that of 
minimizing y ,(T) because y 3 ( Hand S are identical. 
According to equation (5), (he Hamiltonian is 

*(:,x ,0) 

d.Y, d.\, dv, 

~ dr + ‘ 2 dr + ~‘' dr 


= z i [ — y , + u i v 2 + a 2 ] + ; 2 [ — rx . + v , 


~-a 5 0- 

1 1 
+ 

<3 

(36) 

The adjoint variables are defined by 


d£i _ 

i* 

— - — z | — u yz •* 

(37) 

dr 

( X x 


II 

*1 

- - — = rz >-a { z { 

(38) 

dr 

ex* 


d.Vj 

— +r.v 2 = a 4 x,-a,0-a o (31) 

with the initial and the final conditions 
.t,(0 + )=l and .Yj(0 + )=l at t - 0* (32) 
y ,{T) = 0 and ,v 2 (T) =1 at / = T (32a) 
The decision variable 0 is constrained as 
\ 0 \< ! I 

where 

r *— . <r 2 * 0) 

a, = r l K,!K 4 
a, = r 2 /f, 
flj « Af,<r 



o, - rKjA, 

0* * tK$K 4 


.0. r 3 (D = I (39) 

dr ex , 

From equation (39), the solution ofr 3 is 

.-,(/) =|, (40) 

Hence, the Hamiltonian can be rewritten as 

= z,(-.Y,+a.r 2 t- a 2 ) + r 2 ( — r.v 2 + o 4 .v | 

-fl 5 0-fl 6 )+l (41) 

and the switching function J (*, the portion of .W 
which depends on 0, is 

Jf * = -a s : 2 0 (41a) 

Inspection of Jt* shows the basic structure of the 
time optimal control policy is of the bang-bang 
type as in the first example. The conditions for 
which the Hamiltonian be minimum are 

9 » 0*,, - 1 if -a s z 2 < 0 

0 m 0^ m - 1 if -a f Z 2 > 0 (42 
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These conditions also imply that if the switching 
occurs, it will be at 

= 0 (43) 

provided that the controller shifts from 0 mjx to 
0 min instantaneously and inertialessly, or vice versa. 

Now, the maximum principle requires that the 
system equations and the adjoin variables 
equations (30), (31). (34), (37) and *38), be inte- 
grated simultaneously in such a way that the two- 
point boundary conditions 

v,(0 + ) = 1 -v,(n« 0 

v 2 (0 + ) - I -v 2 (D= l 

x 3 (0 + ) = 0 .v^T) undetermined 

r^O*) undetermined r,(T) undetermined 

r 2 (0 + ) undetermined z 2 (T) undetermined 

be satisfied. Meanwhile, the Hamiltonian must 
remain at zero at every point of its response under 
the optimal condition. 

In order to bring the initial deviated state 
[v,(0 + ) = l # x 2 (0 + ) = 1), to the final desired state 
[x x (T) = 0, x 2 (T) = 1], we intuitively start the 
control from 0 = 0 mjI = 1 (this corresponds to 
the maximum cooling action). Substituting this 
condition into equations (30) and (31), and elimina- 
ting x 2 give 

d 2 .v, , dx, ^ 

-^7 

+ (a x a s +a x a b -ra 2 ) = 0 (44) 

The solution of this equation is 

x, * A x exp(A,/)-M 2 exp(A 2 0+tf, 0 g t £ t t 

(45) 

where A , and A 2 are constants and their values will 
be determined later. A, and X 2 are roots of the 
character istic equation 

A 2 +(S+r)A + (''-*i<u) « 0 

and K is the particular solution and its value is 
r-a x a 4 

From equation (30), the solution of x 2 is 

*2 - — K^i + IMi cxp(A t /)+(A 2 + lM 2 cxp(A 2 /) 
a \ 

+*-a 2 ) (46) 

The initial conditions applied to equations (4S) and 
(46) give 

A t ~ ■ r~ *<ii + <r 2 -~ X 2 ~ 1 + M 2 ) (47) 

Xi— 

A 2 - \-A x -K (AS) 


Suppose that the control switches from 0 md , = I 
to 0 min = - 1 at a certain time (switching time /,). 
Then x x (t) and x 2 (/) after /, are solved from 
equations (30) and (31). The results are 

x , ( / ) - D i exp(/,/) !- O, exp* ’ K\ /, g t g T 

(49) 

x 2 (/) = — [(1 + X x )D x exp '/,/) 

<*\ 

4" ( * 4“ X 2 )D 2 exp( X 2 t) + K “Hjl 

/, £ / g 7 (50) 

where 

K > = ra 2 +a x a i -a x a t> 
r—a x a 4 

and Z)| and D 2 are constants, and their values can 
be determined by using the continuity of x, and v 2 
with respect to t. We have from equations (45), 
(46), (49) and (50) at / = /, 

.V|(/ s ) = A x cxp(X|J s ) + i4 2 exp(A 2 r s ) rK 

= D x exp(/,/ s )+ D 2 exp(/. 2 /,) + /C' (51) 

and 

x 2 (0 « — 1(1 +A,M t ex P (*iQ 

a t 

+(1 +A 2 M 2 exp(A 2 r,)+£-a 2 ] 

= — [(1 + cxp(;.,/,) 

+(l+;. 2 )D 2 cxp(A 2 / 1 )+r-a 2 ] (52) 

Solving for Z), and D 2 in terms of A x , A 2 and t, 
from equations (51) and (52), 



D x - A x -E x exp(— x,r.) 

(53) 

and 

D 2 = A 2 -E 2 exp(-A 2 i,) 

(54) 

where 

. W-K) 
E,m 



„ X,{K’-K) 

c ‘~ wl 



The value of t, and that of T can be determined by 
employing the final conditions (equation (32a)] at 
t <m '. Thus, equations (49) and (50) become 

D x exp(A|D+l>| exp (4,0+*' - 0 (55) 

(1 +A,)Z>, exp(A,T)+(l +l 2 )Di expU,r) 

+ JC’-o 2 - a, (56) 

Subtracting equation (55) from equation (56) yields 
k x D x expUjTj+^Dj cxpUjD - «,+«j (57) 

Solving for D 2 exp (i. 2 T) from the above equat'on 
and equation (55) gives 

D t exp(x 2 D - £* 


( 58 ) 
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Subtracting equation (58) from equation (55) gives 
D\ exp(/,D = E y (59) 

where 

a ) +a 2 + 
a \ + a 2 + A i AT 

/ 2 -/i 

We have four unknowns. £>, , /, and 7’ in four 

equations (53), (54), (58) and (59). Solving for 
we have 

\/l , - £ , exp( - /. , O / \ >1 2 - E 2 exp( - k 2 t,)j 

(60) 


E> 

E 4 = 


/, can be solved from this equation by a trial and 
error procedure, and /),, D 2 and T can the* be 
obtained from equations (53), (54) and (58). The 
same numerical values used in Example I are 
employed for r lt r 2 , K 2 , K y and <y. An additional 

constant -4 appears in this and next Ex- 
ample. The solutions for four cases are shown in 
Table 2 and figures 2-4. 



Ffg . 2. rttur *Ja*r jfatt for deferent cures of the me 
CST model with x 2 d 0 mode ■ 10 [Example 2). 

Figure 2 is the phase plane plot, x 2 vs. x %9 for 
different cases with fixed r, of 10, while figure 3 
shows that of Case 1 for different values of r. Both 
figures show a common feature that all the tr^jec- 
tones of jt, vs. x % show one switching point 



Fig. 3. Phase plane pht for Case 1 of the one CST model 
wdh r, d 0 an i * tfferent values of r [Example 2]. 



t 


(^fPMi sBBWPI iWwflw 

OwlV^MClTwdW»Mr,#OWitfmw 
wki V f [Ew wylr 2). 





However, the speed of re*pon e can be observed 
in figure 4. v, decreases asymptotically from / = 0 
to / = 0*847, and then approaches linearly to the 
final desired state. Response of .v 2 concaves 
dowrwara from the initial state to / = 0 * 1 , and 
then inct-ases linearly to t = 0*847, and finally 
decreases linearly to the end. This figure also shows 
the optimal control policy: it operates at 0 = 1 
from / « 0 to / sb 0*847, and then switches to 
0 = — I and keeps operating at 0 - - 1 until the 
final desired conditions are obtained. Additional 
results are tabulated in Table 2. 


L. T. Fan , Y. 5. Hwang and C. L. Hwang 
: can be observed where 


a 42 “ ^4 2 

a 5 — A j F 4 

a b = ^3^4 

The initial and the final conditions are 

.v, ,(0 ' ) = .v, 2 ( 0 + ) = I at i = 0 * 
x n (T) --x n (T) — 0 at / = 7 

where T is unspecified. We are to minimize 

5 = fdt 


Table 2. Optimal solutions of the one CST model together with t 2 # 0. [Example 2). 


Case 

T r in,. 

Ft mil 

*2 

K, 

r 

/. 


Xly 

T 






10 

0-847 

0*074 

1057 

1 0770 






50 

0*838 

0014 

11-59 

0*8875 

1 

30 

0 

15 

1*5 

100 

0-837 

0-008 

1 1 80 

0-861 J 






200 

0836 

0004 

11-92 

0-8485 






500 

0835 

0002 

11-97 

0*8397 






10 

1 266 

0048 

7 10 

1*4584 






50 

1-256 

0 012 

7-80 

1-2990 

2 

20 

0 

10 

1*0 

100 

I 248 

0009 

7-88 

1-2767 






200 

1 247 

0005 

7-95 

1-2664 






500 

1 246 

00002 

7-98 

1 256.3 






10 

2600 

0024 

3-78 

2 6331 






50 

2560 

0025 

390 

2 5860 

3 

10 

0 

05 

05 

100 

2*556 

0010 

394 

2-5654 






200 

2 555 

0008 

396 

2*5598 






500 

2*554 

0003 

399 

2 5545 






10 

5620 

0 013 

1 89 

5*7103 






50 

5 501 

0008 

1 93 

5 6211 

4 

5 

0 

0 25 

025 

100 

54*8 

0*005 

1*98 

5 5010 






200 

5*4*4 

0001 

1 985 

5 4971 






500 

5*493 

0-0009 

199 

5*4935 


A comparison of figures 1 and 4 shows that time 
lag of the heat exchanger is not too important. 

Example 3— Suppose that a life support system 
consists of an air-conditioned room and a heat 
exchanger a* in the preceding two examples. 
However, the flow of air in the room can be 
chat teterized by the two CSTs-in-series model. 
The performance equations of such a system have 
been derived in the section entitled “General 
Performance Equations" in Part 1 of this series(l]. 
Assuming that the heat exchanger has a negligibly 
small time constant (r 2 0), the performance 

equations arc 

“j” + r U*ll * — 


dx.j 

— - +r 


Introducing an additional state variable 


we have 


.Vjf ^ * fd/* 


^ - l. *,(0) - o 

01 


The problem is thus transformed into that of 
minimizing x ,(7*). 

According to equation (J>), the Hamiltonian is 
x,0) m : , ,( — r nJtu .V|, 

-o,,a,'d +«,i) 

According to the definition of the adjoint variables, 
we have 
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dr_jj 

d / 

d£, 

d t 


i\3f 

cx tz 

W 

CXx 


— ~~ Q l \ a A2 z \ 1 + r l 2 Z 1 2 

= o, ^(r) = i 


( 68 ) 


The solution of r, can be obtained from this equa- 
tion as 

r 3 (r) = I, Og f g 7 (69) 

Equation (66) can be rewritten as 
^ (r, .v, 0 ) — r | j( — r , |.v * | + j | 1*14.2 x 1 2 

— ifl 5 0 — flj ia fe +^ 12 ) 

+ r l 2 (“ # ! 2 * v 12 + fl 21 - v ll)+ 1 t^O) 
Therefore, the switching function * is 

** = -tf.,**'-!!® (71) 

Inspection of # * shows that the optimal controller 
should be of a bang-bang type. The control action 
for this problem, however, is constrained in such a 
manner that 

Iff I S 1 (72) 

The conditions for which the Hamiltonian is to be 
minimum are 

0 = = 1 if —Q 1 1^5 1 < 0 

- -1 'f -a ll a 5 'z ll >0 (73) 

In order to bring the initial deviated state, 
jcn( 0 + t * jc» a ( 0 + ) * I at t = 0 *, to the final 
desired operating state, x xl {T ) = x l2 (T) = 0 , at 
r * £, we intuitively employ the control action of 
0 * 6 ^, « 1 (maximum cooling action). Sub- 
stituting this value of 0 into equations (61) and (62) 
and then eliminating * x , , we have 

d 2 x j 2 . dx , 2 

—fifi +(t'n+r, 2 | — ( r 1 1 r 1 2 

— a I \ a A2 a u) X l2+ a ll a S a n+ a l l a 2l a 6 

-a 12 a 2 i = 0 (74) 

Solution of at 1 2 can be written in the form 

x l2 » A exp(A ll 0 + ffexp(A l 20 + ^ 0 S t S t s 

(75) 

where A,, and A , 2 are roots of the characteristic 
equation 

A 2 +(r,,+r, 2 )A+(r n r, 2 -a, 1 a a ,a 4J ') * 0 
and 

a l l a 5 a 2t + a l I a 2» a 6'~ a 12 a 21 


A = 


a l l a 42 a 2l~ r i t r 12 


Inserting equation (7$) and its derivative to equation 
(62) and solving for x u yield 

x lt - “-((An +r, 2 Mexp(;. u r) 

<* 2 \ 

+(Ai2 + r 12 )B cxp(Ai 2 0 + r i2^1* 

0 £ t £ U (76) 


Constants A and B in equations (75) and (76) can be 
determined by employing the initial condition, 
equation (63) and Cramer’s rule as follows : 


A = 


and 


B = 



A r , 2 + 

*12 

1 — K 

1 


'*i2 + *n 

^2 + 

* 1 2 

1 

1 


2 2 1 * 1 2 ~ 

-A 12 + A, 

2* 

An 

*12 


'•l2 + ; -ll 

*2 1 “'l 

2*1 

1 

1 — A 

! 

i 

*11 

“ *1 2 



r , 2 + A M -A n A-a 21 


* 1 |-A 


12 


For 0 = — I, v M (r) and x 12 (f) are solved by 
using equations (6 1 ) and (62). 

x i i(0 ~ ((2 1 1 +r , 2 )Z\ exp(/.j t f) 


*2 ) 


+ (A , 2 , 2)^2 CX P( 3 1 2O T - f 1 2 ^ I* 

f, g | 7 (77) 


and 


x 12 (/) ~ exp(A lt /) + £> 2 exp(A 12 /) + A', 

t s S t ST (78) 


where 


A' = 


^11^21^6 ” G 1 1^5 fl 2 I ~~ a l Z a l l 


a ll tf 21 a 42 1 t r 1 2 

Constants D t and D 2 can be specified by noting 
that x x , and x, 2 are continuous with respect to t . 
We obtain from equations (76) through (78) at 
* = 

*i 2 (0 * ^>i explAnO + ZJjexplAu^+X' 

- A exp(A , , l,) +Jexp(-i, 2 /,) + A (79) 

and 

*1 i (0 

— l(^i i +r 12)^1 ex P(^i 1O 
a 2 1 

-»-(A, 2 + r i 2 )D 2 exp(A I2 f,)+r j 2 AT'] 


a 21 


IUii+'hM exp(A u f,) 

+(^i 2 + r i 2 >®exp(A 12 f,) + r, 2 AJ 


(80) 


Solving for D t and D 2 from these equations leads 
to 

D, = A-E^xpi-tut,) (81) 

D 2 ~il-£ 2 exp{-A 12 0 (82) 


(76) 
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where 

1 2 ~~ 11 
-Ao 

^-1 1 ^12 

We see that £>, and D 1 are functions of / v The 
value of t s and that of T .an be obtained by using 
thehnai conditions 

• v i i(7') = .y i 2 (7) = 0 at t = T 
Equations (77) and (78) thus become 

D, cxp(/. | ,D+D 2 exp(A , 2 r)-f K = 0 (83) 

t(^i i + r i 2)^*1 ex P(^i x T) + (/. x 2 + r , 2 )D 2 

a 2 1 

exp(A| 2 jT) + r l2 /n = 0 (84) 

Eliminating 7Trom these equations and letting 

* 

' m 2~'-11 
zr * *12 


we obtain 

( £ * y»_ ( £ 3 v„ 

(85) 

/, can be solved from this equation by a trial and 
error procedure. Then £> Jf D 2 and T can be 
calculated directly from equations (81) through (83). 

The solutions of this problem are shown sche- 
matically in figures 5-7 and are tabulated in 



Fig. 5, Phase plane plot for Cast 1 of the two CSTsdm 
series model with t, « 0 ami different values of r xx 
4 [Example 3J. 



Fig. 6. Phase plane plot for different cases of the two 
CST s-in~series model with t 2 = 0 and r xl - 1 
[Example 3). 



t 


Fig. 7. Optimal control policies and system responses of 
Case 1 of the two CST' s-tn-series model with r 2 = 0 and 
different values of r xl [Example 3). 

Table 3. The solutions are very similar to those of 
the preceding example. However, one distinct 
difference between the response of the dimension- 
less room temperature in this problem and that in 
the preceding one is that the dimensionless room 
temperature can become negative in this problem 
while it cannot be below zero in the preceding one. 


ft 

£2 
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Table 3. Optimal solutions of the two CST's-in-series model with r 2 ~0 [Example 3]. 
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Case 

T r „„ 

T r min 

A" 2 

A, 

'*i i 

Vlh 

V 1 2 \ 


r 






1-2 

-0 0760 

0*7205 

0*645 

0*992 






1 5 

-0*22^8 

0-4874 

0 518 

1 047 

1 

30 

0 

15 

1*5 

20 

-0-6031 

0 3862 

0 471 

l 078 






5 0 

-3-8727 

0 1852 

0*598 

1 007 






100 

-9-4477 

0-0896 

0*715 

0*956 






1*2 

-0 05% 

0 4538 

0-975 

1-275 






1-5 

-01 703 

0-2984 

0 775 

1-225 

2 

20 

0 

10 

10 

20 

-0-4526 

0-2552 

0*715 

1-24* 






50 

-2 5520 

0 1024 

0-910 

1-25 






100 

-6 0425 

005105 

1 060 

1 25 






1*2 

-00343 

0 1476 

2-015 

2*215 






1*5 

— 0 0498 

0 1 177 

1-635 

1*955 

3 

10 

0 

0 5 

0-5 

20 

-0 2285 

0-0882 

1-500 

1*860 






5 0 

— 1*1295 

0-0353 

1-875 

2 115 






10 0 

-2-6253 

0-0171 

2*180 

2-310 






12 

-00164 

00192 

4-520 

4625 






15 

-00414 

0-0223 

3-780 

3 940 

4 

5 

0 

025 

0-25 

20 

-0 8831 

0-0167 

3 460 

3 640 






5*0 

-0-3865 

0-0082 

4250 

4-360 






100 

-0 8734 

00059 

4-780 

4-841 


CONCLUSIONS 

By now Tedders should be able to realize that the 
maximum principle has a certain advantage over 
other modern optimal control techniques. It is that 
it can be used to evaluate the number of switching 
points of the bang-bang control policy via the 
switching function and adjoint vectors. Three 
examples given in this article take advantage of 
this rule. Furthermore, the maximum principle 
can be applied not only to the system with linear 
performance equations but also to those with non- 
linear performance equations. Bellman[9] proved 
theoretically that the number of switching points 
is me less than the dimension of the problem for 
linear systems. However, this theory cannot be 
applied to non-linear systems. 

It is worth noting that other forms of the 
objective functions can be considered. For example 
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S = /[.v,] 2 dr 
o 

S = /[g+M-v,) 2 ]<I/ 

0 

5 = f[0) 2 dt 
0 

S= /[a+c(0) 2 ]df 
o 

= J[ff+A,(.v,) 2 + r(0) 2 ]d/ 

0 

5= jW-V,) 2 + C(0) 2 ]dA 
0 

S = f|0|dr 
0 

The objective functions have different physical 
significance^, 4, 6]. 
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NOMENCLATURE 


1 



*2 

2jr max min^ 

<*1 

rK { K 4 





* 3 

1 

<*2 

r 2 *, 


^ p Vr man^fr min) 
*-* 2 

<*3 

£,(7 


T, 


rK 4 Ki 

K 4 

1 2 
T, o 

<*5 

rK 2 K 4 



<*6 

rK,K 4 

A 1 1 

T ico 

<*11 

'' 1 * 1,'',./*. 4 

*12 


<*1 2 

r^iKii 

^2c0 

(7 1 3 

T d K x 1 /7V. , 

Q 

(?i + 02 » flow rate of air in the system 




proper in m 3 /s 

<*21 

r i 2^1 2 1 

Qi 

Air flow rate by circulation air in m 3 /s 

<*23 

T^^\iTi r 12 

Q 2 

Flow rate of fresh air in m 3 /s 

<*42 

r A 4 , 2 

Q w 

Flow rate of coolant in m 3 /s 

<*42 

KJK i2 


1 1 

/4 

I ntegration constant 

r 

— , the ratio of time constant of system 
t 2 


Integration constant 


proper to that of fu .it exchanger 

^2 

Integration constant 

''i 

Q\ 

n _ .the fraction of circulation air 

Vl +U2 

B 

Integration constant 


<\ 

Constants defined in equation (3), 
i = 1 , 2 , . . . , $ 


2 

/n L/i * the fraction of fresh air 
yi + v /2 

c p 

Specific heat of air in kcal/kg°C 

''n 


c 

v pn> 

Specific heat of coolant in kcal/kg°C 


m i 

T A 


Constant defined in equation (53) 

r 12 

t 12 

*>2 

Constant defined in equation (54) 

5 

Performance index defined in equa- 

£, 

Constant in equation (53) 


tion (3) 

*2 

Constant in equation (54) 

t 

— , dimensionless time 

£ 3 

Constant in equation (59) 


*i 

^4 

Constant in equation (58) 


Reference temperature in °C 

A f t(0] 

p-dimensional constraints on decision 

tc 

Room temperature in °C 


vector function 0 (f) 

h 

Disturbance temperature in °C 



t, 

Temperature of incoming circulation air 

0(f), 2 (f)] Hamiltonian function defined in equa- 


in°C 


tion (5) 

*0 

Initial time 

jr* 

The portion of Jf which depends on 0 

t. 

Switching time 

K 


?wc 

Inlet temperature of coolant in °C 

r-a l a 4 



K' 

raj+a^s-a,^ 

twh 

Outlet temperature of coolant in °C 

r- a,a 4 

1 1 

Outside air temperature in °C 


T, 

T 

Final time, dimensionless 

Ki 





T cQ 

T t 

(f c - O, room temperature tn ®C 
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T c o Room temperature at a = O* in C 

T ci Temperature of poc! 1 in °C 

T l i o Temperature of pool 1 at a = 0 + in C 

T cl Temperature of pool 2 in °C 

T c 20 Temperature of pool 2 at a — 0 + 

T d (t d - / fl ), disturbance temperature in C 

T ; (',-'«)> temperature of the circulation 

air into the system, in °C 

T i0 Temperature of the circulation air into 

the system at a = 0 + in C 

T Q»P~ c r J T *±- T ? 1 )_ hypothetical 

r QipCp 

temperature 

T r f Final steady state value of T r 

T r raa . Upper bound of T r in ,J C 
T, min Lower bound of T r in = C 


T 

x lt — — , dimensionless temperature of 

T cl0 

pool 1 
T 

x l2 ~sL ^ dimensionless temperature of 

T C 20 

pool 2 

z t {t) adjoint variable defined in equation (6) 


Greek letters 
a Time ins 

a \ f Final time ins 

<5(a) Impulse heat disturbance function, s” 1 
p Air density in kg/m 3 

p w Density of coolant in kg/m 3 

T 

o — , dimensionless disturbance tem- 

t 2 

perature 


T r0 

T wc 

T W h 

T iV 

Tu 

U Q (0 

Vi 

Vu 


Value of T r at a = Oin°C 

C 

twh~ta C 

Temperature of pool 1 in °C 

Temperature of pool 2 in n C 

Step heat disturbance function 

Volume of room in m 3 

Volume of pool l of two completely 
stirred tanks in series model in m 3 

Volume of heat exchanger in m 3 


Vi 


, time constant of the system 


Ql + Ql 

proper in s 

4 

y 

— — , time constant of pool 1 in s 

Qi + Qi 

y 

, time constant of heat exchanger in s 

Q i 


Vu 


, time constant of pool 2 in s 
, control 


Qt + Qi 

T r -j(T rmax + T rmin ) 


T r max \(T r max + T rm t„) 


Vll 

Volume of pool 2 of two completely 
stirred tanks in series model in m J 

0 

vat muiv 

r + 1 at r f = r, m „ 

x(t ) 

i-dimensional state vector defined in 

\-i at r r = r rn)(B 

equation (1) 

m 

Optimum value of 0(i) 

*/('o) 

x i0 ,i = 1, 2, .... 5, initial value of x at 
t = t 0 

4>(x) 

Heat disturbance function 


T 

> 1 

Defined in equation (22a) 

*i(0 

— - .dimensionless room temperature 

T, o 


Constant in equation (43) 


A state variable defined in equation (1 1) 

* 2 

Constant in equation (43) 

x 2 (0 

T 

— , dimensionless temperature of the 

A’ll 

Constant in equation (73) 


1 10 

circulation air in equation (31) 

A 12 

Constant in equation (75) 


B 
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On presente la forme fondamentale du principe du maximum de Pontryagm qui est 
la clef de la theorie moderne de controle optimal. Le principe est applique a la deter- 
mination des polices de controle optimal de plusieurs sy>temes de support de vie ou de 
controle d'entourage. 

On considere trois exemples concrets dont tous se rapportent an controle de tem- 
perature d'un systeme de support de vie constant d’une r-ihine ;i air condition^ 
(le systeme lui-meme) soumis a une perturbation de duiieur par impulsion, et d'un 
echangeur de chaleur (Telement de controle). Le premier exemple traite le cas dans 
lequel la cons*ante de temps de Techangeur de chaleur est negligeable. Le second 
exemple considere le cas ou la constante de temps de l'echangeur de chaleur nest pas 
ignore. Dans le troisieme exemple on etudie la police optimale du systeme ou le 
courant d'air dans la cabine peut etre caracterise par les deux modeles de vaisseaux en 
serie (2 CST en serie) completement agites. Dans cet exemple, on neglige encore la 
constante de temps de Techangeur de chaleur. On donne de fa^on detaillee les pre- 
cedes et les techniques par ordinateur employee pour obtenir les polices de controle 
optimal. 


Die grundlegende Form von Pontryagin's Maximum Prinzip ist dargestellt, welches 
der Grundstein der modernen Optimalkontrolltheoi ist. Das Prinzip wird fur die 
Feststellung optimaler Kontrollverfahren fur verschitdene Lebensunterhaltungsoder 
U mgebungskontrollsysteme angewandt. 

Drei bonkrete Beispiele werden ins Auge gefasst, wobei alle sich mit der Tempera- 
turkontrolle von Lebensunterhaltungssystemen befassen, die aus einer klimatisierten 
Kabine, (dem eigentlichen System) bestehen, die einem Warmestorungsimpuls 
ausgesetzt wird, und aus einem Warmcaustauscher, (dem Kontrollelement). Das erste 
Beispiel behandelt den Fall, in dem die Zeitkonstante des Warmeaustauschers 
unbedeutend ist. Das zweite Beispiel behandelt den Fall, in dem die Zeitkonstante 
des Warmeaustauschers nicht vernachlassigt wird. In dem dritten Beispiel wird das 
Optimalverfahren des Systems untersucht, in welchem die Luftstrdmung in der 
Kabine durch zwei grundlich gemischte Reihentanks (2 CSTs-in-series) im Modell 
geschildert wird. In diesem Beispiel wird die Zeitkonstante des Warmeaustauschers 
wieder vernachlassigt. Verfahren und berechenbare Betrach tungen zum Erhalten 
optimaler Kontrollverfahren werden mit Einzelheiten gegeben. 
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Applications of Modern Optimal Control 
Theory to Environmental Control of 
Confined Spaces and Life Support Systems* 

Part 3 — Optimal Control of Systems in which State Variables 
have Equality Constraints at the Final Process Time 

L. T. FAN f 
Y. S. HWANG t 
C. L. HWANG t 

The basic form of Pontryagin s maximum principle is extended to cover optimal 
problems with equality constraints imposed on the final state variables . The 
necessary conditions for optimum contr ol policy are developed and are applied 
to two concrete examples. 

* * ' ’ v \ 3 77ie dy namic behavior of the life support system consisting of an air-conditioned 

* 4 * cabin (the system proper ) subject to an impulse heat disturbance and a heat 

exchanger (the control element ) is again studied. The first example considers 
^ the optimal control policy for a system having a heat exchanger with a negligibly 

| small time constant. The square form of the final condition of the state variable 

is considered as an equality constraint. The second example considers the 
^ optimal policy of a system where the flow of air in the cabin is characterized 

;,\3 .* 1 by the two completely stirred tanks-in-series (2 CST's-in-series) model. The 

RlVlC -V - . ■ - dme constant of the heat exchanger is not neglected , that is, the response of 

* the heat exchanger is not instantaneous. The squares of the final conditions 

of the state variables are again considered as equality constraints. 
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INTRODUCTION 

The basic form of Pontryagin’s maximum prin- 
ciple, has been introduced in the preceding part[l]. 
Here we shall extend the basic form to cover the 
optimal time problem with equality constraints 
imposed on the final state variables. 

Kopp[2,3] adjoined the equality constraints to 
the objective function via Lagrange multipliers 
and then solved the problem by a trial and error 
procedure. Denn and Aris[4] treated the problem 
by the Green’s function approach. We shall first 
obtain the necessary conditions for optimum by 
adjoining the equality constraints to the objective 
function via Lagrange multipliers and taking a 
weak variation of the resulting expression[5]. The 
necessary conditions thus obtained will be applied 
to two concrete examples. 


♦This work was supported by the Air Force Office of 
Scientific Research, Office of Aerospace Research. United 
States Air Force, Under Contract F 44620-68-0020 (Themis 
Project), and NASA Grant Under Contract NGR-17-001- 
034. 

t Institute for Systems Design and Optimization, Kansas 
State University, Manhattan, Kansas. 


NECESSARY CONDITIONS FOR 
OPTIMALITY FOR TIME OPTIMAL 
PROBLEMS WITH EQUALITY 
CONSTRAINTS IMPOSED ON THE FINAL 
STATE VARIABLES 

Again let us consider the differential equations 
of the following form 

0,(0, 0 2 (O 0,(01, / = 1,2, ...,s (I) 

with the initial conditions given by 

*,(/<>) “ *«)♦ * = 'o (2) 

Suppose that we wish to determine the control 
vector 0(f) so as to minimize (or maximize) 

S = jF[*(O,0(O]<if (3) 

to 

subject to the (/-dimensional constraint on state 
variables at the unspeerfied !>:rminal time, T, as 
shown below. 

HiWm - 0, q (4) 

PRECEDING PAGE BLANK NOT PBAIF5> 
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where initial time t Q is then fixed and T is the 
unspecified control terminal time. Here the ob- 
jective function, equation (3), is different from the 
form used in Part 2 of this scres[l]. However, we 
can transform equation (3) into the form used in 
Part 2 by introducing an additional state variable 
.\% + i such that 

WO* jF[.v(/),f^?]d/ (5) 

fo 

It follows that 

dV ;■ J ~ = F[.s(t).0(t)] (6) 

a ' 

= /, + 1 [.Y(/),W)] 

• V s+ l(^o) = ® 

and hence the objective function now becomes 

5 = x s+l {T) (8) 

or 

S = Ir,v l( r) (9) 

i=i 

which is in the standard form used in Part 2 with 
Ci = 0, / = I, 2, ..., s 

^s+l = 1 

Suppose that the equality constraints, £*[*(7)] - 0, 
and the performance equations, equations (1) and 
(6), are adjoined to the objective function via 
Lagrange multipliers, r 4 and z { . 

S' = £ C i .v i (7')+ £ I'igiWn] 

i-i < = i 

+ ( 10 ) 
We can then define the Hamiltonian 

.r[x(/), 0(0, r(0] = 'fzjiim 0(0] (1 1) 

1 = 1 


and then inserting these relations into equation ( 12) 
and carrying out the Taylor series expansion about 
the optimal state, a\ 5, f, and T. Retaining only the 
linear terms of the resulting equation and then 
dropping the bar notation give 


6S' = ^7’j.# , [.v(7’).d(7'),r(7')] + fr, 
f \x, y d.v,(7-)) 

,\ < r ,r i dr j 


1=1 0 - 1 ( *\ t ) 



We must ^et this first variation equation at zero to 
obtain the necessary conditions for a minimum. 
The resulting equations which determine the optimal 
control and state vectors are as follows: 


■#(x(t),0(t ),:(0] = ),«(/)] (15) 

I — I 


C.yf d.Y: , 

/ = 1,2.. 

...5+1 

- — = + -j7 = / i [.v(/),(l(/)], 

(iZi d t 



(16) 

<]£ _ d£^_ 

Ox, d / [Z idx," J ' 

/= 1,2,. 

.. , 5+ 1 





(17) 

.o-i 

eo, jiao, ’ 

/= 1,2,. 

...r (18) 

These represent the (2 j+2) 

differential equations 


for the two-point split boundary value problems. 
The condition i at the initial time are given in 
equations (2) and (7;, whereas those at the final 
time are 


and substitute this relation into equation (10) to 
obtain 

S' = lW")+ iv i g,[x(T)]+ ] U[X(0, 

i»I i “ 1 In l 

( 12 ) 

The first variation of S', 6S', which is defined as 
SS' = 0, f , T] 


may be obtained by letting 


*i0) = *A0+txi(O, »-l,2, .. 

.,5+1 

0#)-0j( 0+m0, /- 1,2,., 

,.,r 

T = T+dT 

(13) 

2,(0 - i 60+ Sift), / - 1, 2, . 

J+1, 


iff) = I<- 


IEl 


j^ j e x ,(T) 


+c„ / = 1,2,3,..., j+1 


(19) 


and 


.#[x(T),0(T),z(T))+ t 

I- 1 vl 

»+t ?x, *+i dv,(D 

+ I c < S “ I iff)^7jr “ 0 

i„l Cl /- 1 qT 


( 20 ) 


Equation (19) provides (j+1) conditions with q 
Lagrange multipliers to be determined. Equation 
(4) provides q equations which can be used for 
elimination of the Lagrange multipliers, and 


* Derivation of equation (14) is given in the Appendix. 
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equation (20) provides one additional equation 
which cpn be used for determination of the un- 
specified terminal time. 

It is worth noting that when the constraints 
)] = 0 are not imposed on the final state 
variables, the necessary conditions derived here 
reduce to those derived for the basic problems 
presented in the preceding article! 1 ]. In other words, 
equations (19) and (20) reduce to 

z,iT) = c, (19a) 

#[x{T),0(T),ziT)] = 0 (20a) 

The set formed by these equations and equations 
(15) through (18) is identical to that formed by 
equations (5) through (8) m the preceding article. 
Equation (20a) is correct because the minimum (or 
maximum) value of the Hamiltonian is identical to 
zero at every point of time t for the time optimal 
problems. 

The final condition, x(T) y which is fixed in the 
fixed right-end problems can be considered as the 
simplest case of & i [.v(7')] = 0. 


EXAMPLES 


Here the necessary conditions developed in the 
preceding section will be applied to the following 
examples. 

Example I —Let us reconsider Example 1 of the 
preceding articled ]. The statement of the problem 
remains the same. Now the square form of the 
final condition of the state variable can be con- 
sidered as an equality constraint on the state 
variables at the control terminal time, i.e., 

gAxiT)] = \[x x (T)] 2 = 0 (21) 

We now wish to show that at the optimal condition 
the two necessary conditions at the control terminal 
time, equations (19) and (20), are satisfied. Em- 
ploying equations (19) and (20), we have 


fix AT' 

Z\(T) = v t x x (T) ~ — f Ct = v l x l (THc l (22) 

, T , , 4*,(r>j J 

Z 2 O) - 2 « + C 2 ~ c 2 


f)x 2 (T) 

.^W), (Knzdn+c.x.m 


dx x (T) 

dT 


dx,(D , d X 2 (T)' 

" ^ 1 . _ + C 2 . _ 

d T d T 




djr,(D dx 

z,(r ~dr“ +r2 r)— dr 


£}1 
i T J 


jr[ X (T), 0<n urn 

0 


(23) 


(24) 


Since 

<’> - 0 
r 2 = K 

equations (22) and (23) become 

= AT) = r,.v,(D (22a) 

- Z (T) = 1 (23a) 

Equations (24), (22a) and (23a) assure us that this 
type of problem can be solved by making use of 
the necessary conditions presented in the preceding 
section as well as those presented in Pan 2 of this 
ser ; es[l]. 

Example 2— As mentioned in Examole 2 of 
Part 2(1), the response of the heat exchanger as 
we 1 ! as that of the cabin or room is not always 
instantaneous. In Example 3 of the preceding 
article, we considered the system consisting of a 
room or cabin with the flow of air characterized by 
the two CST's-in-series model and a heat exchanger 
whose time constant is negligibly small. Here we 
consider a slightly different system in which the 
response of the heat exchanger is not instantaneous. 
The performance equations are [see equations (43) 
through (45) in reference 6], 


dx, , 

-r- + *• 11*11 = o,,x 2 +a t2 

dr 

(25) 

dx, , 

. + r l 2*1 2 a 2 1*1 1 

0/ 

(26) 

d* 2 n 

-j— -hr.v 2 - a 4 2 .x i 2 @ 5 ^ 

(27) 


with the initial and final conditions 
*u(0 + ) = *i 2 (0 + ) - a* 2 (0 + ) = I at t = 0 + 

*u<n = x X2 m = (Uj<r) = 1 at t = t 

(28) 

where T is unspecified. The control variable. 0, 
is constrained as 

| 0 | S 1 (29) 

We wish io determine a piecewise continuous 
control variable 0 so that the response of the 
system can return to its desired state in a minimum 
period of time, that is, 

S - J dr (30) 

o 

is minimized. 

We shall first make use of the basic form of the 
maximum principle presented in Part 2 of this 
series to solve the problem. Let 

i 

x 3 (i) « j dr 


", . 
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The solution of .v, 2 has the form 


£-1. 

dt 


v,(0) = 0 


(31) 


Hence we have 

* = -l|[-f l |V 11 +fl 11 .V2+fl 12 ] 

+ T| 2 ( - r i 2-Vi 2 +«2 1*1 |] 

+ r 2 [--rx 2 +fl42- v i2- fl s <,_a 6] + :: 3 
d.-,, 


dr 

dr, 2 

dr 

d£2 

dr 


- r \ l = ] \ ~~ U 2\ Z \2 


(32) 

(33) 


— r I l Z 1 2 ~ *42- 2 


= rz 7 -a x 


^2=0. :>(T) = 1 
dr 


(34) 

(35) 

(36) 


It follows from equation (36) that 

r,(r) =1. Oi/g f (37) 

Equation (32) can then be rewritten as 

,W = r, ,[ — r, ,.v, , +a, ,.v 2 +a, 2 ] + r , 2 [ — r i ’ v i 2 

+ 2 1*1 i +r 2 [-r* 2 +fl42*i 2 -fl 50- fl o!'+l 

(38) 


Therefore, 


.W* = -fl 5 r 2 « 


(39) 


An optimal conttol corresponding to this case 
should be of the bang-bang type. Thus the con- 
ditions for optimal control (minimum .if*) are 

ft = - 1, if -a 5 r 2 > 0 

ft — + 1. if -o 5 z 2 < 0 

In order to bring the initial deviated state, 

x, ,(0) = x , 2 (0) = * 2 (0) =1 at t = 0 

to the final desired state, 

jr,,(r) = * 12 (D = 0, x 2 (T) = 1 at t = T, 

we shall first apply the control 0=1. In other 
words, we have ft = I in the interval 0 g / g t, x . 
Substitution of ft = 1 into equations (25) through 
(31) and subsequent elimination of and x 2 
from the resulting expressions give rise to 

d J JCi 2 

IP 


Jjjf 

j y j 3 +0*+ r i I +r t 2 ) u, j:i 4 +(r i t r i 2 + rr u 


+ rr l + ( rr I l r l 2 I! 


d/ 

f* 12*21 “*3*1 1*21~*1 1*21*6 


x 1 2 = A exp(Ai/)4£exp(A 2 /)4Cexp(A 3 M4 A, 

(41) 


0 g / S /si 


vshere A , and C are constants and A, . A 2 and A, 

are roots of the characteristic equation 

A 3 4(r4r, , 4r 12 )A 2 4(/\ ,r 12 4rr, ,4rr 12 )A 

■f(/r, i/*i 2 -a, 1^21042) = 0 ( 42 ) 

and K is a constant and its value equals to 

^12^2 | “tfjGi i* 2 1 ~*l 1*2 l*h 


K = 


1 1 r 1 2 — ^ 1 1 * 21*42 


(43) 


Inserting equation (41) and its first and second 
derivatives to equations (25) through (27) and then 
solving for .v , , and .v 2 lead to 

= — [(Aj+r^M exp(A,/)4(A 2 4r l2 ) 
a 2 1 

B exp(A 2 /)4(A 3 4r| 2 )C exp(A 3 /)4r, 2 A], 

0 s t £ t % \ (44) 


and 

*2 = 


1 


[A[).\ 4(r, ! 4* r 1 2 )A , 


Let 


*11021 

4r, ,r 12 ] exp(A,/)4fi[A5 + (r, , 4r l2 )A 2 
+ r, ,rj 2 ] e\ptA 2 /) + C[A 3 4(r l t 4r 12 )A 3 
-Hr i x r l2 ] exp(A 3 /)4/*i x r x2 K-a X2 a 2 \}< 
0^/^z 3 i (45) 

>li = A, 1 r l2 
/l 2 = A 2 +r l2 

A 3 = A 3 4r, 2 

^4 = Aj +(f| j +rj 2 )A| +r, jf, 2 
= A 2 + (^i i + r i 2 )A 2 +^| l r l 2 
A 5 = A 2 + (r, j 4r, 2 )A 3 4r 4 x r l2 

A 7 = *2 i ~ r I 2^ 

>(. = 1-* 

A 9 — *1 1*2 I 4*1 2*2 1 ” r l l f l 2% 

Then equations (41), (44) and (45) can be rewritten 
as 

X| i = — [A \A exp(A|/) + i4 2 Scxp(A 2 /) 

*21 

4^ 3 CcxpU 3 /)4r l2 /a 0 S i <> t tX 

(46) 

x xl « A cxp(Ai/)40exp(A 2 /)4Cexp(A 3 f)+K. 
0^^ lt < 47 > 
1 


(40) 


*2 


*11*21 


[A 4 A exp(A,f) + < 4 5 «exp(A,0 
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+ A h C expUjO + r, ,r , 2 AT— o , 2 a 2 ,], 

0 g / g (48) 

Values or A, B and C can be determined by em- 
ploying the initial conditions 

v,i(0 + ) = v, 2 (0 + ) = ,v 2 (0 + ) = I at t = 0* 

Hence, equations (46) through (48) become 

A t A + A 2 B+A 3 C = 4 7 

A + B+C — 4„ 

A + A $B-\- Af,C — Ay 

Solving for A, B and C by using Cramer's rule, we 
have 

A = A , , A , 0 
B = A 1 2 A 1 0 
C = 4 1 3 4 tn 

where 

4 in = 4 1 4 h + 4 2 4 4 + 4 - 4 5 — A , A 5 — A 2 A ,, 
-4,4 4 

4 11 ~ 4(.4-"f42-l(i'f4j/li;4D — 4 ,4, — 4 2 4 h 4 s 

- 4j4 9 

4)j ~ A 1 4 A $ A + A i + A $A t) — 4 , 4 9 — 4 ^4 7 

- 4 j 4 4 4 g 

4 , 3 — 4,4 9 + 4 2 /t 8 4 4 + 4 7 4« 4 1 4 5 4 8 4 2 4 9 

- 4 4 4 7 

Similarly, for/,, g t g r, : ,wehave 
0 = -1 

v., = — [4,4’ exp(x,t) + 4jB' exp(x 2 f) 

-I 4jC'exp(A,0 + r 12 /C], /„ g / g r, 2 

( 49 ) 

•V 1 2 = 4'exp(A,f) + i*'exp(A 2 /)+C'exp(A 3 /) + K', 
t.i t, 2 (50) 

and 

,v 2 = — - — (4 4 4' exp(A,/)+4jB' exp(A 2 /) 

+ 4*C exp(Ajf)+r n r, 2 A."-fl 12 <j 2 ,]. 

t ti ( 51 ) 

where 

X' » rfl u a r» +°s <, t i g n ~ fl i i g n g t 

and 4', B' and C are unknown constants. 

For i <2 g t g T, we have 


0 - 1 

-v , , = — [4,4" exp(A,f) + 4 2 fl" exp(A 2 o 

a i 1 

+ 4jC" exp(/, /) + /•,, A], /, 2 g / g 7* (52) 
-V , 2 = 4' exp(A,/) + B" exp(/ 2 f )+ C" exp(A,/) + A, 
*, 2 g / g T (53) 

v 2 = — - — \A t A" exp(A,f) + A S B" exp(/. 2 t) 

a \ l l7 21 

+ A h C" exp(/. 3 f) + r, ,r , : A -a, 2 a 2 ,l 

f, 2 g / < T (54) 

where A", B'' and C" are unknown constants. 

We know that x , j , x , 2 . and .v 2 are continuous 
functions of t. Therefore, f\ B\ C’ and 4", B'\ C” 
can be determined by using the continuity of .v, 
•v, 2 and v 2 with respect to t at t = /, , and t = f, 2 . 
Thus 

v n (t,,) = — -[4,4 expf/.,r,,) + 4 2 flexp(/. 2 /, 1 ) 

a 2 I 

+ 4 3 C exp(A 3 /,,) + r , 2 A] 

= —[4,4' exp(A,f J ,)-t-4 2 fl' exp(/. 2 r,,) 
a 2 1 

+ 4jC’ exp{/. 3 /,,) + r t 2 A ) (55) 

v, :(',,) = 4 exp(A,/,,) + flexp(A 2 /,,) 

+ C txp(A 3 /,,) + A 
= 4' exp(/,r,,) + fl' exp(/ 2 /,,) 

+ C’ exp(A 3 /,,) + A' (56) 

and 

.v 2 (/,,) = — [4 4 4e\p(;,r tl ) + 4}flexp(;. 2 / J ,) 

+ 4*C exp(Ajf, l ) + r,,r, 2 A-u :2 <i 2l J 

« — — [d^'expfAtf,,) 

+ 4,5' exp(;. 2 r 11 )+4 6 C" expfx,r„) 

-br 1 ir 12 A-a l 20 2 i] (57) 

Solving for A', B' and C in terms of f,, from 
equations (55) through (57) gives 

4 - 7 ^ (58) 

A n 

B - ^ (59) 

* 17 

c *4*2 

4,7 


( 60 ) 
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where 

A 1 7 ~ | A 5 — A 2 A b 

-A y A 4 )exp(/ ) exp( exp( 

/f jH — 14 ."^ « T/ ^ 5 ^ 1-4 

- A 2 A b A , 5 - /I yA 1 Jexp(/ 2 /, , ) exp</ y t s , ) 

-^^ l4 -i 4 .^ 4 ^ l ,)exp(/ l / f |)exp(/. 3 r %l ) 
^20 = f ^ 1 A b + A jA+A j 5 + A 1 4/! 5 — A 1 A $A j 5 

- A 2 A 1 to - A 4 A , 4 ) exp(A , r, , ) exp</ 2 /, , ) 

A i 4 ~ °2 1 V 1 l(^il )“" r 1 2 % 

A 1 5 — v, 2 (/, f)~ 

A lb = 1^2 l v 2(f*|) + fl l 2^2 1 ~ r t l r ! 2^ 

Similarly. A ", B" and C" can be determined by 


A" = ^ 

(61) 

^24 

to 

II 

■l? 

(62) 




c = -- 

(63) 



where 

A 24 ~ (A \ A b + A 2A 4 + A yA $ — A iA $ — A jA b 

-AyAJ exp(/,/, 2 ) exp (/ 2 / j2 ) exp(/ 3 / a2 ) 

A 25 = Mfe^ 2 l +^ 2 ^ 23 ‘b^ 3 ^ 3 ^ 22 ~^ 3 ^ 2 l 

- ^ 2 /l 2 2 “ AyA 2 y) CXp(/ 2 /, 2 ) CXp(;. 3 /, 2 ) 

A 2b ~ (A i A b A 22 ^ A 4A 2 \ ^ A yA 2 }"“ A ^ A 22 

-A ti A 2i -A y A 4 A 22 )txp(). l t, 2 ) exp<A 3 / % 2 ) 

A 2 / 885 M 23 + ^ 2 ^ 4 ^ 2 2 + A S A 2 | — A \AyA 2 2 

A 2 A 23 A 4 A 2 1) cxp(/ 1 f j2 ) exp(/ 2 / j2 ) 

A 21 = fl 2 l v l |(^i2i” r ! 2^ 

^22 * ' V l2(^a)~^ 

^23 * fl l l fl 2 l- v 2(^«2) + tf i2 a 2 I “* f ll r l2^ 

Wc can find /,,. /, 2 and T from equations (52) 
through (54) and the final conditions 

•v,i(r)- .v I2 (7)-0,x 2 (r)« I, at/ - T 
Thus 

^^"exptA^i-h^jB'cxpt^jrj + ^jCex^T) 
+r n *-0 ( 64 ) 

^ #, cxp(^ l r)+j M cxp(^ 2 D^r , exp(A 3 r)+#: - o 

(65) 


A 4 A c xpUtD + Ayff" cxp(/' 2 F) + A„c exp </.,7 ) 
+ r, \r X 2K-(*\2 a 2 \ -Ui ia 2 » =0 (66) 

In principle, we can solve for 7, and / %2 from 
the above equations by a trial and error procedure. 
However, and /, 2 appear implicitly in these 
equations, which increase the difficulty of solving 
the problem. To circumvent this difficulty, we shall 
continue to solve this problem by considering the 
square form of the final conditions of the state 
variables as equality constraints and by employing 
the additional necessary conditions developed in 
this article. 

The equality constraints on the final state 
variables are 


K,[v( 7-)] = i l-v 1 1 ( 7*) — 0] 2 = J(v, ,(7)] J = 0 (67) 

* 2 MDJ = i[v,i(7’)-0] 2 = J[.y i3 (7)] 2 = 0 (68) 

J?jlv(7)) = i(v 2 (7)-l] : = 0 (69) 

Therefore, equations (19) and (20) for this problem 
are 

-i i(7) = i‘, ,.V| i(7) + r, 


*[x(T)JKT),:m] + 

A', AT) 


-i AT) — r 1 2- v i 2(7 )+<'j 
zAT) ~- *'j[-Vj( 7)~ l)+fi 
.*3(7-) = f 4 

d.Y, ,( 7 ) 


(70) 

(71) 

(72) 

(73) 


f'. 


v,,(D 


dr 


+ , i: v i2(7*)* 


L 




dr 


d 7 ’ 

+ f 2 


T d.v, ,( 7 ) d.v l 3 ( 7 ) _ o.» 2 i 

+ f| .. 


+ r 2 [v I (ri-l]^Pj 


d.Vj(f) 


d.v 3 (D 

dT 


]-[- 


dr +<J dr 
dv, ,(r> 


1 1 


( 7 ) 


<?r 

dY;(7) 


dr 

+ " m ^ } ] - 0 

By substituting equations (70) through (73) into 
the above equation, it can be shown that 


Jf (*( 7 ), 0 ( 7 ), .*( 7 )] - 0 ( 74 ) 


Since the objective function, equation (30), has 
been transformed into the following form 


5 - c,jr, »(7)+ Cj.tr, i(T)+c i x 2 (T)+c 4 xAT), (75) 
e i m c t m c, - 0, c, - I, 
equations (70) through (73) become 


*»»<D- «iixii(r) 


( 


(76) 
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, 2 <n = 

<1 2 ' 12 (F) 

(77) 

: : iT) = 

r,[.v 2 (7-)-!j 

(78) 

:>(T) - 

1 

(79) 


and from equations (32) and (74), we ha\e 


in this example, its value is very smal' Thus, the 
initial trial control pattern is assumed to he the 
optimal control solution given in Example 3 of the 
preceding part[l j. that is 

0 = l 0 g / g 0*468 


nvfn^n :(nj 
- 0 

,, r>( — r , *-«. I1 .v 2 (n+« IJ i 

+ ->2(T){ — r i i.V| 2 (7)4 u 2 ,.v, t {T)] 

+ : 2 ( T)[ - rv 2 ( T) + u 4 ,.v , 2 ( T ) -«,(>( T) 

">l h )r\ (80) 


Determin..ii>>!' ,»f ;he terminal control time, T . 
from the above equation in conjui,ction with the 
performance equations, equation for the adjoint 
variables, and constraints is very difficult, if not 
in. possible. However, T may be obtained by using 
the grHicnt pro. va.ic witn the penalty function 
approach. This penalty function can be written as 

S'' = [<• ,.v t ,(r) + r ,.v , j(7j + Cj.v 2 ( T) + <- 4 .v 3 (ni 

■b i !*’» I [ ' I |( 1 )J 2 + t'l 2 I ' I 2(F)) J 

+r I |.v J (D- 1 ] 2 ! ( 81 ) 


and the terminal control time, T, can be determined 
by the condition 


dS" 

dr 


l+r,,.V|,m 


d.v,,(7) 

dr 


+ r i J v i 2 (r> 


dv.a'r) 

dr 


+ 'j(v J (r)-l]-- < ^P = 0 (82) 

Note that <| = =* * 0,r 4 = hand 

***& ) . 
df 


In other words, the terminal control time is chosen 
so that the penalty function, equation (81), is at a 
minimum with respect to this terminal time. It is 
possible, however, that the terminal time deter- 
mined by equation (82) may not be the time which 
minimizes the penalty function. If there is any 
question concerning this assumption, we may 
examine the sign of the second derivative of S " 
with respect to T when the first derivative of S" 
with respect to T is zero, or we may carry out an 
exhaustive search or random search around this 
point to assure that it is indeed a minimum point. 

Since the control policy is of the bang-bang type 
shown in equation (39) and the performance 
equations are linear, the number of switching 
points is one leu than the dimensions of the system 
as mentioned previously! 1, 8). Even though the 
time constant of the heat exchanger is not neglected 


0 = - I 0 468 < / g MOO 
0 = I MOO < / 


where the switching times, and t , 2 . are 0 468 
and MOO respectively. 

With this initial trial control pattern the state 
variables .v,,, v, : and v 2 can be obtained from 
equations (46), (47) and (48) for 0 g t g /,, , from 
equations (49), (50) and ($ I) for g / g f, 2 ,a nd 
from equations (52), (53) and (54) for /, 2 g t g f, 
where the terminal control time, 7, is unknown. 
This unknown terminal control time is then 
determined from equation (82). 

The switching times, and r, 2 , and the terminal 
control time, T, can be determined by simultane- 
ously minimizing the penalty function, S”, given hv 
equation (81) and satisfy ing the condition given by 
equation (82). This can be accomplished by em- 
ploying a variety of techniques, for example as the 
sequential simplex pattern search(9] or the Hooke 
and Jeeves pattern search[IO]. 

By use of the final time and value of v(/), we can 
solve the adjoint equations, equations (33) through 
(35). backwards f rom T to 0 with the final conditions 
given by equations (7o) through (78). 

Let 

t h * T—t (83) 

Then 

d/j> = -d / 

Equations (33) through (35) become 



r * t*i i 


(84) 



* : 42 : 2 »2*l 2 


(85) 


d-l 

dr, 


= a, ,r, , -r: 


(86) 


Eliminating , mvd r l2 from these equations, we 
have 


d*r 2 .d*Sj 

+(»’ + » , ) , +r, 2 )-^y +(rr 11 + r ll r ) , 

dxi 

+ "u> j-tf,i0j,a 4 j)ri - 0 


Solution of ; 2 has the form 
r, - D esp(/ ! f,)+ £ exp(x 2 rj+f expf^,/,) (87) 
where D, E and Fare unknown constants. Inserting 
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equation (87) to equations (84) through (86) and 
solving for z , | and z , 2 , we have 

-ii == — [£>(/., + r) exp(/. ,/,,) 

, 


/: = 

h = 


_2 

0 !■) 

0, i 
0, o 


+ £</. , + r) + F(/., + r) exp*/.,/,)] where 


( 88 ) 


and 


0,o = 


1 

0, * - 

- 1 2 = 

iOUi +(r + r, ,)/., +rr, ,] exp(/. ,f„) 



«II«2I 



+ £[/; + (r + r 11 )/. 2 + r,r i exp)/.^,) 

0,2 - 


+ Ff/. : , + (r + r, ,)/.., + rr , ,]/. cxp</.,f*)! (89) 


Let 


0,.. = 


0,0, + 0 2 0 (> +0,0 4 -0,0 h -0.0 4 -0,0, 


0,0, + 0,0*0.,+ 0,0, - 0„0, - 0 4 0„ 


- 0 , 0 , 0 , 


0,0, + 0„0- + 0,0 4 0, ~ 0, 0.,0* - 0 4 0- 

— 0 , 0 , 

0 , 0 , 0 „ + 0 2 0 . 0 4 0 - - 0 , 0 , - 0 , 0 4 0 „ 


0, = ;.,+r 
0 : = ;.j+r 
0, = /..,+r 

0. = '-‘i +(r + r, , 

0, = Aj+fr + rnUj+rr,, 

0 h =- /i f(r + r n )/.j + rr, 

Filiations (87) through (89) become 

miU*) = — lDB<exp<Atr h ) + £B 2 cxp<;. 2 / t ) 

<* it 

+ FB>cxpO.>t>)) (90) 

r , +(/,>) = — *— [DB 4 exp{/. ,#*>+ EB<exp(/. 2 t h ) 
a \ 

+ W fc exp(/. 3 f*)] (9i) 

(92) 

At / « T, /> *= 0, equations (76) through (78) 
become 


, ,(0) = r, ,.v, ,(0) 

(93) 

u(0) - r i j* i j(0) 

(94) 

z 2 (0) - r,[.tj(0)-l] 

(95) 


Also at t> - 0 equations (90) through (92) become 

Z>*, + £S 2 + fB, -fl M : tl (0) (96) 

DB 4 + EB$-¥ FB$ * <i| |0 2 \Z | j(0) (97) 

£>+£+£ «r a <0) (98) 

Solving for D, E and F from these equations, we 
have 


-5 5 £l 7 

By = q \ * /* 1 1 *v 1 2 (0) 

® tl| jtf 2 |T | 2-*' i j(0) 

B «, = ^[^(O)- 1] 

The condition // = 0 as given by equation (80) 
is verified by substituting the values of state 
variables obtained at the terminal control time, 
v, ,(jT),.v, 2 (T),and .v 2 (r),and the adjoint variables 
at the terminal control time, r tl (T), c l2 (7*h and 
r 2 (D, into the equation. 

The optimal control pattern determined is shown 
in figure la. The optimal result is such that the first 
switching time is 0.487, the second switchingtime 
t %2 is 1.085, and terminal control time T is 1.096. 
The value of terminal control time is 0.018 longer 
than that of the case in which the response of the 
heat exchanger is negligibly small (Example 3 of 
Part 2[l]). In actual practice, the difference can be 
neglected. In general, the response of the heat 
exchanger is almost instantaneous, especially 
when the time constant of the heat exchanger is 
much smaller than that of the system proper. 

The optimal response of is also given in 
figure la and the corresponding responses of x l2 
and .Yj are given in figure lb. Values of the system 
parameters employed in obtaining the numerical 
results correspond to those of Case 1 given in 
Part 2 of this series. 


CONCLUSION 

The reader should realize that the fixed right-end 
problem can also be solved by considering the 
problem as one with equality constraints on the 
final state variables and then employing the 
necessary conditions derived in this article* 
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Fig. 1 a. Optimal control policy and optimal response of 
x i , for Case I of the two CST 's-in-series model with 
r 2 f 1 0. r, , = 2 and r = 10. 




rig. 1 b. Optimal responses of x l2 and x 2 jor Case 1 of 
the two CST s-in-series model with r, ~ ftandru = 2 
and r = 10. 
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APPENDIX 

Derivation of equation ( 1 4) from equation ( 1 2) 

The objective function, S\ is of the ibrm given by 
equation (12), ;,e. 


(A.l) 

Carrying out the Taylor series expansion of the 
above equation about , 0, £ and T \ defining 


s' - X c,x,(r)+ £ WiMrj] 

/-l I«1 

+ J {#w, m, 2(oi- 1^,(0 


*i(0 - x,{t)+6xp), i = 1,2 *+ 1 

#*1,2, ...,r 

T = T+&T, 

ip) * 2p)+tep), #= 1 , 2 , ..., 5 + 1 , 

discarding the terms higher than the first order, 
and dropping the bar notations, we have 

ss ' * *1 ^-^77+ 
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+ 


T (' 'l* . ' 1* . , 

J] 1 77 <>•'•.+ I 

( i i ( i i i ‘ ’’i 

’ . vT dv, 

y — <>z ( +—-<»- y <>z - J 

, I <r, ' Ct fy\_ dr 

./ d.v,\ /drjd.v, d 2 .v,\."| 
\ d / / \ d/ d/ df 2 / j 


(A 2) 


jince 

rr* 

in 


’ <# 


f — - Sldt = f -z— d tSt = X rST 

/. ft " I 

-+(=■£+ 

-(=•£) 


and 


XM*)* 

Mir ^ 

= I I -i'jT (<>- v i)df 
< i #« O' 

s+ir T d’ ~l 

equation (A.2) becomes, after rearrangement, 

US' = arj.tfW), 0(T), -(^)]+.I n 

+?, 1 «?r £f ( J dr } 




This is equation (14). 


NOMENCLATURE 

a 5 = rA 2 A 4 

a b = r A 3 A 4 

Oi i = r i^i i r i i/-^4 

fl 12 “ r i r 2^ii 

a 2 1 * ssr i2^ia/^n 

a 42 « fA 4 /A |2 


>4 = Integration constant 

4, = Constants in equations (45) through 

( 66 ) 

# = Integration constant 

fl, = Constants in equations (90) through 

(92) 

c, = Constants defined in equation (9), 

/ — 1.2 ,^+l 

C = Integration constant 

D — Integration constant in equation (87) 

£ = Integration constant in equation (87) 

£ = Integration constant in equation (87) 

£,[ v(r)) = a ^/-dimensional constraints defined in 
equation (4) 


-*[xU), 

0(f), r(r)] = Hamiltonian function defined in equa- 
tion (11) 


w* 

= The portion of W which depends on 0 

K 

- A constant defined in equation (43) 

K' 

= A constant defined in equation (51a) 

i Y 

= h 

A 1 

T c0 

*2 

2£ ma * 

*3 

= 27^ (^rnui + ^rmln) 

*4 

*-k 

II 


= J\ 

^lcO 

*,2 

m JjL 

^2c0 

e 

= Qi + Q 2 > flow rate of air in the system 
proper in m^/s 

e, 

= Air flow rate by circulation air in m 3 /s 

02 

= Flow rate of fresh air in m 3 /s 

Gw 

= Flow rate of coolant in m 3 /s 

r 

= — , the ratio of time constant of system 
*2 

proper to that of heat exchanger 

'i 

Q\ 

■ — — — , the fraction of circulation air 
Gi + Gj 


r 



.\pph\ nitons of MnJein Optimal Coniu'l ’ Tha % r\ 


\ ^ 



c>- ... . 

P r m ( ^ 

I’ppcr bound ot T r in C 

r 2 

-- — - - . the Iraction ot Iresh air 



Q Q: 

^ t mm 

- Lower bound of if, in C 

1 i i 

JL 

r„ 

\ alue of T t .it 7 0 m ( 


T|| 

r H . 

-- / Ut - in C 

f \i 

1 2 


=• C 

S 

= Performance index defined in equa- 


- Temperature of pool I in C 


tion (9) 

T,: 

- fAmperature of pool 2 in ( 

S' 

- A modified performance index defined 

r 

- A Lagrange multiplier in equation ( 10) 


in equation (10) 

f . 

- Volume of room in m 3 

<T 

= A modified performance index defined 

< M 

= Volume of pool 1 of two complete!.* 
stirred tanks in senes model in m 3 


in equation (81 ) 

t 

= *■-. dimensionless time 

1 , 

- Volume of heat exchanger in ni 3 


1 1 

> 

= Volume of pool 2 of two complete!) 

t a 

= Reference temperature in C 


stirred tanks in series model in m 3 

G 

= T-t, dimensionless time used in equa- 

W) 

= .s-dimensional state sector defined m 


tions (84) through (86) 


equation ( 1 ) 

!, 

= Room temperature in C 

v 

“ v l0 , / - !, 2 s. initial \alue ot 

Ij 

= Disturbance temperature in C 


v at t = t {) 

/, 

- Temperature of incoming circulation 

•\,(M 

T ( . 


air in C 

= — , dimensionless room temperature 

in 

= Initial pmc 


T 


= Switching times. / =1,2 

v ,(/ > 

- — - , dimensionless temperature of the 

fs» 


T 

1 to 

l wt 

- Inlet temperature of coolant in C 


circulation air in equation (27) 


— Outlet temperature of coolant in C 

V| I 

T 

= , dimensionless temperature of 

i r 1 0 
pool 1 

r : 

= Outside air temperature in C 


T 

= Final time, dimensionless 



7, 

= (/ f ~/ a ), room temperature in C 

• V l 2 

= zr^ * dimensionless temperature of 

*r2 0 

T t o 

- Room temperature at a = 0* in C 


pool 2 

r € , 

= Temperature of pool 1 in C 


= adjoint variable defined in equations 
(10) and (17) 

r 4 ,o 

= Temperature of pool I at a = 0 + in C 



= Temperature of pool 2 in Q 



^(2 0 

= Temperature of pool 2 at x = 0 + 

Greek letters 


= ( t d - tX disturbance temperature in C C 

x 

~ Time ins 

7*, 

= tempeiature of the circulation 


= Final time ins 


air into the system, in r C 

d(a) 

= Impulse heat disturbance function, 

F.o 

= Temperature of the circulation air into 


sec " 1 


the system at x = 0 + in X 

p 

« Air density in kg/m 3 


= Ha} , hypothetical 

Pw 

** Density of coolant in kg/m 3 



T, 


temperature 

Q 

* — , dimensionless disturbance tern- 


= Final steady state value off. 


Jn* 1 11 







4 ^ 

if ' 
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ti 


*i , 




*12 


= , time constant of the system 

Qx + Qi 

proper in s 

= li — , time constant of pool 1 ins 

Q^Qi 

y 

= — time constant of heat exchanger 

Q i 

in s 

y 

= — * — , time constant of pool 2 in s 

Q\ + Qi 


0 

T, 

able 

nui tmr 


_ l + l 
“ \-l 

«« T r = T, „„„ 

at T r = T, min 

m 

= Optimum value of 0(1) 


= Roots of equation (42) 


, control van- 


La forme fondamentale du principe du maximum de Pontryagin est elargie pour 
couvrir les problemes optimaux avec contraintes d'egalite imposees sur les variables de 
Tetat final. Les conditions necessaires pour une police de controle optimum sont 
deveioppees et appliquees a deux exemples concrets. 

Le comportement dynamique du systeme de support de vie qui consiste en une 
cabine a air conditionne (le systeme lui-meme) soumis a une perturbation de chalcur 
par impulsion et un echangeur de chaleur (relement de controle) est encore etudie. 
Le premier exemple considere la police de controle optimal pour un systeme ayant un 
echangeur de chaleur avec une constante de temps negligeablement petite. La forme 
carree de la condition finale de la variable d'etat est consideree comme une contrainte 
d egalite. Le second exemple considere la police optimaie d’un systeme ou le courant 
d’air dans la cabine est caracterise par le modele des deux vaisseaux en serie (2 CST en 
serie) completement agites. La constante de temps de Techangeur de chaleur n'est pas 
neglige, c'est-a-dire que la reponse de Techangeur de chaleur n'est pas instantanee. 
Les carres des conditions finales des variables sont encore consideres comme con- 
traintes d'egalite. 


Die grundlegende Form von Pontryagin's Maximum Prinzip vird erweitert, urn 
Optimalprobleme mit Gleichheitsbeschrankungen zu umfassen, welche den Veran- 
derlichen des Endzustandes auferlegt waren. Die notwendigen Bedingungen fur 
Optimum Kontrollverfahren werden entwickelt und bei zwei konkreten Beispielen 
angewandt. 

Das dynamische Verhalten des Lebensunterhaltungssystems wird untersucht, 
welches aus einer klimatisierten Kabine (dem eigentlichen System) in Abhangigkeit 
von einer Warmeimpulsstorung und einem Warmeaustauscher (dem Kontrollelement) 
besieht. Das erste Beispiel untersucht das Optimalkontrollverfahren fur ein System, 
v.clches einen Warmeaustauscher mit unbedeutend kleiner Zeitkonstante hat. Die 
Quadratform der Endbedmgung der Zustandsveranderlichen wird als eine Gleich- 
heitsbeschrankung angesehen. Das zweite Beispiel untersucht das Optimalverfahren 
eines Systems, in dem der Luftstrom in der Kabine curch zwei vdllig durchgeriihrte 
Rcihentanks (2 CST's-in-series) im Modell dargestellt wird. Die Zeitkonstante des 
Warmeaustauschers wird nicht vernachlassigt, d.h. die Reaktion des Warmeaustaus- 
chers ist nicht unverziiglich. Die Quadrate der Endbedingungen der Zustandsveran- 
derhchen werden wieder als Gleichheitsbeschrankungen dargestellt. 
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Part 4 — Control of Systems with Inequality Constraints 
Imposed on State Variables 

L. T. FANt 
Y. S. HWANGt 
C. L. HWANGt 

The necessary conditions for optimum of a dynamic system whose state variables 
are constrained by certain inequality conditions are derived by applying a 
f \ ^ , variational technique. The conditions are employed to determine the optimal 

policy for the room or cabin temperature control of a life support system. 
The system consisting of an air-conditioned cabin subject to an inpulse heat 
disturbance and a heat exchanger acting as a control element is again studied. 
The flow of air in the cabin is characterized by the two completely stirred 
v; : tanks-in-series (2 CST's-in-series) model. A constraint is imposed on the room 

temperature which has to be higher than a certain value for some physical or 
biological reasons. 


INTRODUCTION 

THE BASIC form of Pontryagin's maximum prin- 
ciple has been introduced in Part 2 of this seriesfl] 
and the optimal control of the systems in which 
inequality constraints are imposed on the state 
variables at the end of control action has been con- 
sidered in Fart 3[2]. In this part, we shall consider 
the necessary conditions for optimum for a 
dynamic system whose state variables are con- 
strained by a certain inequality condition or con- 
ditions. Chang[3], Berkovitz[4] and Gamkrelidze 
[5] dealt with the fundamental aspects of the 
problem, and both the theoretical and computa- 
tional aspects were treated ta papers by Dreyfus[6], 
Denham[7] and Denbaui and Bryson[8]. Despite 
these and other efforts[9-12], ue optimal control 
of a system with state va.-Lible constraints does not 
appear to be well understood. Here we shall first 
state the problem and the necessary conditions for 
optimum, and finally apply the conditions to the 
temperature control confined spaces and life 
support systems[ 13]. 

* This work was supported by the Air Force Office of 
Scientific Research, Office of Aerospace Research, United 
States Air Force, Under Contract F 4462<M>8-0020 (Themis 
Project), and NASA Gram Under Contract NGR-17- 
001-034. 

t Institute for Systems Design and Optimization, Kansas 
State University, Manhattan, Kansas. 


a 


A DYNAMIC SYSTEM WITH STATE 
VARIABLE CONSTRAINT 

Again let us consider a continuous process, the 
dynamic behavior of which can be represented by 
the following set of differential equations. 

= /itv,(/W') x % {t);0ft)J) 2 (t) 


0,(/)U= L 2 .v (!) 

or in vector form 

^ = rim* mi <ia> 


where xU) is an s-dimensional state vector and 0(0 
is an r-dimensional control vector. Now, we wish to 
find a piecewise continuous control vector 0(0 in 
the set 0 such that the function of the final state 

s 

S - £ Ci.v,(D. c, = constant (2) 

l» 1 

takes on its minimum (or maximum) value, subject 
to the condition that x(t) stays within a specified 
region of the state space given by the inequalities 

fiW*X«(0U0. /-1.2 q (3) 

The duration of control, T, is specified. Functions 
/i, S and gj are assumed to possess continuous 
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derivatives to at least the second order[3, 12]. In 
addition to these, the state vector must satisfy 
certain initial or final conditions or both. 

NECESSARY CONDITION FOR OPTIMUM 

The basic form of Pontryagin's maximum prin- 
ciple for systems without state variable constraint 
is given in Part 2 of this series[l]. It states that the 
Hamiltonian ,)f and the adjoint variables are 
defined bv 


w = I o(t)] 

,= 1 

dfi <5£ y 

dr At, h ?x, 

i = 1,2 .s 

= c„ i=1.2 j 


(4) 


(5) 

( 6 ) 


and the necessary condition for the objective func- 
tion S to be an extremum with respect to 6 is 


£-0. 


1, 


(7) 


or 

= extremum on the boundary of the con- 
straint (on decision variables) and the extremum 
value of the Hamiltonian is constant at every point 
of time under the optimal condition. 

For systems with equality constraints g,[x(r)] 
= 0, / = 1 , 2, .... q, imposed on the final state 
variables, the necessary condition for the objective 
function to be extremum remains the same except 
that equation (6) becomes 


* n -£."sSfc + * '-'- l 


( 8 ) 


;=! 


It also gives rise to the following additional con- 
dition at the control terminal time. 


*W),0(7'),2(r)]+ I j±t 

j-t cl 


~ dx, 
i+ C ‘ 67 


~ I 

1*1 




w 


Equations (8) and (9) were derived in the preceding 
part of this series[2]. 

For the system with one primary state variable 
and with one inequality constraint imposed on the 
state variable, the condition that the Hamiltonian is 
constant under the optimal condition remains the 
same. However, it has been explicitly indicated[14] 
that by employing the chain rule, the condition 
given by equation (5) must be rewritten as 


dz k Mr 4fi df^dO 

d7 " “At, “ ~ Zl d t -2 ‘ dtl d t 


( 10 ) 


because, the state variable and the control variable 
are related through the constraint on the constraint 
boundary. Here we wish to prove that the Hamil- 
tonian is also constant along the constraint boun- 
daries under the optimal condition for a system 
with two primary state variables represented by 

~ =J\[x,.x 2 ,0„0 2 ] (ID 

"j" = .v 2 , 0,, Ojl" (17) 

and with the objective function of the form 

s = J F[x„ x 2 . 0„ 0 2 ]dr (13) 

0 

subject to the inequality constraints 

g,[x,, .v 2 , 0„ tf 2 ] S 0 (14) 

g 2 [x 1 ,x 2 ,0 1 ,0 2 ]£O (15) 

|0|£l (16) 

Introducing an additional state variable, ,v 3 , such 
that 

■v,(t) = } A[.y„ x 2 , 0„ 0 2 ]df 

o 

it follows that 


and 


or 


^ — F[x i • -v 2 , 6'(, 0 2 j 
v 3 (0) = 0 

x 3 (T) = S 

S = I C/ x i(T) 

i=i 

c, = c 2 = 0, c J = 1 


07) 

(18) 

(19) 

( 20 ) 


Thus, the problem is transformed into that of 
minimizing x 3 (T). 

According to equation (4), the Hamiltonian is 


Jf — 2,f,+Z 2 f 2 + Z 3 f 3 

and the adjoint vector is defined by 


( 21 ) 


<*£i = JJH = _ fJA , ,£,00, 

dr dx t 1 |_Ay, 6x 2 dx t 80, dx. 


60 2 

dx x 

Pfi 

60, 

80, 

dx t 

• 

6F 


dx. 

6F 

60 2 


( 22 ) 
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<*£2 = JJL = _ r + + ai± < h ( ( h ( hi^j 

d < Sx z “‘U'-Vj ?x t fix 2 60, fix 2 + fi0,fix,fi0 2 fix,J ^[fix^fixjfix, 


Vt fiO* 

fi0 2 fix 2 

Jh d h. 


■ r 7h + i i±t±i 

.VlfiO, fif 2 fi02\ 1 

dx 2 C.Y | C.Y 2 

60, fix* 60 2 fix,) ( 


l 

!_ 


\f\PO 
00 1 dx 2 00 2 dx 

f cF dfdxj dF 66, 
Z3 l d *2 + ^ A 'i dx 2 +dO 1 dx 2 

dF fl? 2 1 
d0 2 dx 2 \ 


dfl 

d / 


e $ 

— -0. z 3 (T) = 1 
<x 3 


(23) 


(24) 


Note that equations (22) and (23) are different from 
that defined by equation (5), because the state 
variables and the control variables are related 
through the equality constraints, equations (14) or 
(15). For this reason, differentiation of the Hamil- 
tonian with respect to .v, must be carried out by 
employing the chain rule of differentiation. Also 
note that equations (22) and (23) reduce to equation 
(5) when the state variable x(t) is interim to the set 
of constraints, equations (15) and (16). The solution 
of equation (24) is 

r 3 (/) = I, Og /£ T (25) 

Thus, equation (21) can be rewritten as 

* = Zj/i+^/a + f (26) 

The derivation of the above equation with respect 
to t is 


dJT dF dr | , dz 2 

17 = di +f 'd7 +fl !7 +z 


HY, 

1 [dfl, dt 

1 

dO 2 dt £.y, 1 cLy 2 2 J 

S'.] 


fio, et eo 2 dt ex , 


Inserting equations (22) and (23) into equation (27) 


i jr > , 

+ i7/' 


gives 


dJf 

dr 

dF 

m d7 +Z ‘ 


IB 

> 

1 t 


IB 

M 

l 1 


fiF_ 

60, 

<y L 

dx, 

fifl 

fix, 

fiF 


^ + T- r ( b l± 

Iv, fi0 2 fix,) J 1 |_ 1 \dx 2 

‘Vi Mi Vi Mj i\ (Vi 

dO , cLy 2 dO 2 dx 2 ) ' m \ dx 2 


dx x 
dx 2 

d.Yj dj 2 dO j df 2 d0 2 
dx 2 + 00 x dx 2 + d0 2 dx 2 

dx t 0F_ dOj cF cOjX 
dx 2 *** dO j <\y 2 + 00 2 dx 2 / 


OF 

dx 2 


(28) 


Since .v,. .y 2 . 0 { and 0 2 are functions of t only, we 
can write the following equation. 


dx 2 d.\ 2 dx 2 (dx i 


dx j 


d.v , 


dr / dr 


= Uit\ 


fl.Y, 

d.v, 

d.v, 

1 d.v j 

=/.// 


" d.v 2 

~ 17 

/* 


dO, 




<v" 

" dr 




60_ 2 

d<? 2 




fit 

dr 




60, 

_ d 0, 

_ d 0, 

/d.v, 

do, 

fix, 

~ dx, 

dt 

/dr 

dr 

60, 

dO, 

dO, 

/'d.v 2 

dfl, 

fix 2 

~ dx i 

~ *, 

/ dr 

- dr 

fi0 2 

_ 60 , 

_ *£i 

/d.v. 

_ dO 2 

fix, 

“ d.v, 

dt 

/ dr 

dr 

fi0 2 

_ dO 2 

_ d0 2 

/d.v 2 

d0 2 

dx 2 

~ ^2 

~ d 'i 

I dr 

~ dr, 


ii 

ft 


(27) Inserting these equations into equation (28) gives 


dJf dF OF OF dO t dF d0 2 

dt = Jl dx { f2 dx 2 ~dO x dr ~d0 2 dt 

_ f2 Vl.. 2 r e J±-rz d h- 

fl1 fix 2 lJl dx 2 h l 6x, 

, dfi , 60, d± 2 

~ Jl2 dx, 1 60, it l 60 2 dt 

6h6± 

“ Z2 c0, dr d/ 


( 29 ) 
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Note that we have used the relation 


d F 
dl 


-If H ( ]I 'll H 

8x] Jt+ d Xl j2 + eO t df + (0 2 d t 


(30' 


When the extremal solution is on the constraint 
boundary, 0(1) is determined in terms of the state 
variables and the independent variable ' by the 
relation shown in equation (14). The corresponding 
neighboring solution must satisfy 


cW, 
= 0 


rO, 


A 6 ^I An x (lg ' An , A , frl A 

dgi = T7T ^0,+— d0 2 + -dx l +- r - d.v. 


<.v , 


cx ] 


or solving for 


d 0 i 
dr 


d l± = A-gt <>g i f Pgi f V <teiY l 

dr \d0 2 dr f d.v , 1 cx 2 2 J\cO l ) 

(31) 

Inserting equation (31) into equation (29) leads to 


d Jf 
dr 


- 0 


(32) 


or Jf is also constant along constraint g, = 0.* 
Similarly we can prove Jf is constant along con- 
straint g 2 = 0. 

This proof can probably be extended to the 
general cases. For a system whose dynamic be- 
havior can be represented by equation (1), the 
necessary condition for the objective function, 
equation (2), to be extremum on the boundary sub- 
ject to the constraints, equation (3), is that the 
Hamiltonian remains constant on the constraint 
boundary, or 


and the adjoint variables are of the form 



The condition Jf(T) = 0 must hold when the 
control terminal time T is left free. 


EXAMPLE 

Example 3 in Part 2 of this seriesp] is recon- 
sidered here. In the example, the dimensionless 
room temperature assumes negative values during 
part of the control period. Very often, however, the 


* Proof of this statement is given in the Appendix. 


room temperature has to be higher than a certain 
value for some physical or biological reasons. This 
requirement becomes the constraint of the problem. 
The performance equations are 


d*n 

d/ 


+ r l l' V l 1 “ a l \ Q M V 1 2 “ a 1 l a 5 0 


,a b +a, 


1 2 , 

d, +r - v ” 

II 

C: 

Ki 

< 

■ s 

© 

II 

P 


-v 12 (0) = 1 at 

o 

11 


.Vj ,(7) = 0 at t = T 
x l2 (T) = 0 at t = T 


(35) 

(36) 

(37) 

(38) 


where T is unspecified, The control variable and 
the state variable are constrained as 


I 0 I S 1 (39a) 

^ m (39b) 

We wish to find a piecewise continuous control 
variable 0 such that the system can be brought back 
from the initial deviated state, equation (37), to the 
final desired state, equation (38), in the minimum 
period of time. In other words, the objective func- 
tion given by 

T 

S = f dr (40) 

o 

is minimized. Note that a constraint is not imposed 
on x 12 because it is known from Example 3 of 
Part 2[1] that x l2 does not cool down to the 
negative dimensionless temperature. 

During a period in which the inequality con- 
straint. 


jc, , > nu 

is satisfied, the solution obtained in Example 3 of 
Part 2 is still applicable. Thus during such a period 
we have [see equations (75) through (78) in Ref. 1]: 

*11 = -^-[Wii+'-| 2 Mexp(A ll O+U, 2 +r,j) 
"2 1 

flexp(A 12 f)+r 12 tf], 0g/g/ M (41) 
x xl = A exp(A| + exp(4 12 f) + /f, 

0 (42) 

*i i — “ Ui i Fr x] )D t exp(A t |f)+Ui 2 + f i j) 
«21 

Oi exp(;. 12 /)-fr 12 r], (43) 

*12 - D l exp(X ll t)+D 1 txp(k il t)+K', 

( 44 ) 

where 
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a 1 1^4 2 a 2 1 r 1 1 r I 2 

a \ \ a 2\ a (>+ a \ ) a S a 2 \+ a \ 2 Q2\ 
a n a't 2 a 2] -r n r ]2 


C = exp (r i2 tj >4 expU, ,rj + £exp(;. 12 rj 


_mo 2 _L^ ^ 


(50) 


^ ~ r 1 2 ~ * 1 2 + ^ 1 2^ 

*11 *12 

g — r » 2 + Au — /. n K — I 

*ll“*12 

*u 

+ \ [(^n+^i2) 2 ^4(r M ri 2 -qi t q 2l q 42 )] 
2 

*12 

— I ~^ r i2> 

~\ (('n +^,2> ;! -4(r l ,r, 2 -a,,a 2l a 4 ;)] 
2 

and where 0, and D 2 are unknowns; whose values 
will be determined iater. t su is the arrival time when 
the state variable *, , reaches the boundary where 
a , 1 - m. t sd is the time when .v lt departs from 
the boundary. 

Since a*, , = m on the boundary, equations (35) 
and (36) become 

mr u « a xx a A2 x x2 -a^ x a , f> 0-a xx a , b ^a X2 (45) 

+ r l 2 V 1 2 = ma l I (46) 

or solving for a , 2 , we have 

Xj 2 = + C exp (-r l2 t\ t < (47) 

r \ 2 

The corresponding 0 and .v , , are 

0 = [aua A 2X\2-a\\<*i> + <*i2-™r n l 

fl n a 5 

*m £ t* ft (48) 

-Y , , — nu t„ £ t £ t^ (49) 

where C is an unknown, the value of which can be 
determined by inserting .x u = m into equation 
(41) and solving fo r Then t M may be substituted 
into equation (42) to solve for C. Thus 

x t2 * A exp(A, jfjJ + flexpU^O + A:, t = t M 

from equation (47) 


Because of the continuity of a*,, and x , 2 with 
respect to /, we have at t = t^ d 

-v, { (r sd ) = m 

- — [Ull+ r l2>^l CXP^IlO 
«21 

+ (/.i 2 + r n )0 2 c\p(/. xl tJ^r x2 K] 
from equations (43) and (49), and 


ma 2 1 

x 1 ?( t wl ) = + C exp( — r , 2 /, u ) 

r 1 2 

= D\ exp(/., 1 / WJ )+Z> 2 exp(/. 12 04-A 


from equations (44) and (47). Solving for D x and 
D 2 from these equations leads to the following 
expressions. 

D> = 

I - A + / ^ i + Cexp(-/* 1 2/ w ) exp(/ l2 t 5d ) i 

i r,i | 

I -r l2 *' + mq 2l (A, 2 + r , 2 ) exp(/ n yJ 1 

| exp<;., exp(/ 12 /J 

' U , 1 + r , 2 ) exp(A , , f J (* , 2 + r 1 : ) exp(A , 2 tJ\ 

= +(/ 12 + r l2 ) 

(- K' + + C exp[ - r , 2 /J ) 

A H 1 7 (51) 

(;. 12 -A, 1 )exp(/ ll tJ 

and 


n 2 = 


— r 1 2 K 4* ma 2 j +■ ( / 1 1 4* r t2 ) 

(A 1 2 — A 1 j ) exp(A 1 2 ^) 


(52) 


We now can see that D , and D 2 are functions of 
r w . Their values and that of T can be obtained by 
making use of the final conditions of equations (43) 
and (44) at f = T. Thus 

— [(A u + r,,)D, exp(A lt r)+(A ,2 + r, 2 ) 

<»21 

OjexpCA.jD+r.jAf l- 0 (53) 


ma it ~ 

•V,2 « +CCXp(-r,2r M ). I m t m 

r ti 

Solving for C from these two equations, wt obtain 


D x exp(A,,r;+D a exp(A|jT)+/f' * 0 (54) 

Solving for D, exp(A, ,T) from equation (54) and 
then inserting it into equation (S3) yields 
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2 (/| 2 *“^ii)exp(/| 2 r) 

Inserting equation (55) into equation (54) and 
solving Z), gives 


J (;. 12 -/,,)exp(; MI 7) 

Equating equation (51) to equation (56), and 
equation (52) to equation (55). we obtain 

Z), = 

-r s2 K'-nui 2x +(k x2 + r x2 ) 

H -I Cexp[-r 12 /jj 
,)exp(;. n D 

'*• i i * 

(;.i 2 -;. n )exp(;.,,r) 


Table 1. Minimum values oj the objective junction (dura non 
of control) for Case 1 of the two ( ST's-in-.series model with 
r 2 = 0 and various values m in the inequality constraint 
xi , £ m. 




S = 

T 

n i 

m * -0*2 

ni = —04 

No constraint on \ 

i 2 

0992 

0*992 

0 992 

1-5 

! 051 

1 047 

l 047 

20 

1*233 

H03 

1*078 

5 0 

2-483 

1*998 

1 007 

10 0 

3*457 

2*862 

0956 



and 
D z = 

-r x2 K' + Ma 2X +ti xx +r x2 ) 

( a c expi “’ ri 
(A , 2 1 1 ) exp(A , 2 tJ) 




(Aj 2 A| !) exp(/i 27") 


respectively. Eliminating the common factor 
(A j 2 — / j , ) i n these equations gives 


/uK'expf/,,/*) « exp(/., J)y {1 K -ma lx 


+ Cexp(-r 12 / w ) V (57) 


k xx Ktx p(A, 2 /J *> exp(A, 2 




1 

, \Lr ma " 

"^'•A 7,7 

- T I 


+ Wfl 2 , 


-Ccxp( 


(58) 


t u and T can be solved from equations (57) and 
(58) by a trial and error procedure. Then D t and 
D 2 can be obtained directly from equations (51) 
and (52) by substituting the value of into the 
equation. 

The solutions of the problem are tabulated in 
Table I and are shown schematically in Figure I . 
The optimal control policy is of the bang-bang type 




Fig, 1. Optimal control policies and system responses for 
Case 1 of the two C ST' s- in-series model with r 2 = 0 and 
r 1 1 * 2 and with a constraint on the state variable. 


as shown in Example 3 of Part 2 of this series[l]. 
However, because of the existence of inequality 
constraint on the state variable .r M , the optimal 
control policy 6 takes some intermediate value 
other than 1 or - 1 during part of the operation. 


Table 2. Simulation of Case 1 of the two C ST' s-in- series 
model with r 2 - 0, r, j * 2 and x t , £ -0-2 


Control Variable 0 


i < 

< / < u 

n < t < t u 

»- < • <T 

T 

10 

- 1*0 

10 

- 1*0 

No solution 

1*0 

-to 

0*8 

-to 

No solution 

10 

-to 

0 * 

-10 

No solution 

10 

— 0*8 

10 

-10 

2*535 

1*0 

- 0-8 

0*8 

-10 

2*363 

1*0 

- 0*8 

0*6 

-10 

2*249 

to 

— 0*6 

10 

-10 

1435 

10 

- 0*6 

0*8 

-10 

1 388 

10 

-0*6 

0-6 

- 1*0 

1 336 



-5 


ftm j* ■ 


* 
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Simulation of this piohicm with r M 2 ami 
\ , . 0 2 has been k.u i icd out e Oensiveiy h\ the 

phase plane approach and icsulls oi the simulation 
ire tabulated in Table 2 and ate also show » 
uraphiCitlK in I igurc 2 ( iicsc icsuii s v. i m t It i lil ! ! 

the solutions m Table i aic 1 1 ul\ optimal 


< Speulic heat ol air in kcal ke ( 

i Specnic ’neat ol coolant m k^ tl ke * 

/), t nknown eoiistam in equation «4 m and 
(44 1 

I) { nknown uiMtt.rd 1 1 ’pnihuns <43i at" 1 
(44) 



:/ I he mcquahtv >. <mai uni > < 12 

// ] \[ : . (((<). :[ t )| I Lt milt on tan I unci ion Oclnu d 
equation (4> 



A 

\ om>tant 

m cqt alums Ml 1 

1 1 hi ough 1 44 


A 

\ uMlstillll 

in cpunl i< l - 1 i i 

i tin nuuh ; l i 


A 

i 

(/, 

2/; 

/ ) 



A 

1 

- (/ 

2! : 



1 

9*0 8 
9 -- - o 

A * 

A i j 

1 : 

/In 

1 : 

/ .... 




A , , 

/ . 




/ /e 2 \initihllinii of ( <Mt* l nf lift lv\n ( S / Vw-w i n \ nn>th ! 

ti tth r ' 0 r s , \ </»</ \ 0 2 

conch sions 

It should be evident that the necessary conditions 
for optimum for processes with inequality con- 
straints imposed on the state variables remain the 
same as those for processes without state variable 
constraints. One exception, however, is that the 
adjoint variables possess the form shown in 
equation (34) instead of equation (5) on the con- 
straint boundary. 

Another fact which should also be pointed out is 
that Pontryagin’s maximuni principle which can 
handle constraints on state variables is probably a 
more useful form of the calculus of variations than 
the Bol/a form which cannot treat constraints! 14] 

NOMENCLATURE 


IU 

At A 4 


A 3 A 4 

«I1 

r i A j i r , i A, 

U|2 

r l r 2 A t , 

1 

r 1 2 A j 2 ‘ A , J 


</ 4: fA' 4 A',> 

KJK IZ 

A Integration constant 

B Integration constant 

i( Constants defined in equation (2), /• !, 

2 j 


m \ h>wer bound dimensionless icmper.iiiiu <>r 

' 1 1 

(J (J f fh>* ratc a,r m 
proper m m ' s 

(J , Airflow rate h> circulation air m ir 1 s 
(J , 1 low rate of fresh air m m ' s 

(4 V , I low rate of coolant in m ’ s 

r , — — , the fraction of circulation air 

/ , — the fraction of fresh air 

Qs + Qi 

c 

'n — 

Ci 

r i 

r m 

1 1 : 

S Performance index defined in equation ( 1) 

t -- , dimensionless time 

ti 

r sil Switching time when the state variable \ ] ) 
reaches the boundary where v t , - m 
t %(i Switching time when v, , departs from the 

boundary 

Inlet temperature of coolant in C 
t„ h Outlet temperature of coolant in 'C 

T Final time, dimension leas 

T c Room temperature in °C 

7Vo Room temperature at « ~ 0* in C 

Tel Temperature of pool 1 in C 
T e io Temperature of p**! ! at « « 0* in C 




4 V*s 1 


I 





4 

i' 
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T ( 2 Temperature of pool 2 in C 
T f 20 Temperature of pool 2 at a = 0 + 

7j Disturbance temperature in C 
T, Temperature of the circulation air into the 
system in C 

T ti) Temperature of the circulation air into the 
system at * = 0* in C 

T r T z * — Tzsl hypothetical tempera- 

lure 


.v,(/ 0 ) v (0 . / = 1,2 s, initial value of v at 

t = /„ 

-v t , ~ - . dimensionless temperature • t pool I 

' < 1 0 

v, 2 ~r^~ . dimensionless temperaiure of pool 2 

' r 2 0 

r,(/) adjoint variable defined in equation (5) 
Greek letters 


T r 


Upper bound of T r in C 
Lower bound of T r in C 


T, o 

Value of T r at x = 0 in C 

*1 

Qi + Qi 

T vc 

'w. -'a in c 


y 

K, 

t wh -t a \n C 

*11 

v 1 1 
O 

Tn 

Temperature of pool 1 in C 



Tu 

Temperature of pool 2 in C 

T 2 

i , 

- , timei 

1 j 

A Lagrange multiplier in equations (8) arid 


V\ 


Density of coolant in kg/m 3 
Vx 


in s 


time constant of pool I ins 


(9) 

y i Volume of room in m 3 
\ , , Volume of pool 1 ot two completely stirred 
tanks in series model in m 3 
l\ Volume of heat exchanger in m 3 
y % 2 Volume of pool 2 of two completely stirred 
tanks in series model in m 3 
.*(/) j-dimensional state vector defined in equa- 
tion (I) 


y 

r . i ! A- . time constant of pool 2 in s 

Q< + Q 2 

0 + -control variable 

+ I at T r = T r mux 
“I at T r = T rmn 
/ , , Constant in equation (41 ) 

/. , 2 Constant in equation (42) 


REFERENCES 

1. L. T. Fan, Y. S. Hwang and C. L. Hwang, Applications of Modern Optimal Control 
Theory to Environmental Control of Confined Spaces and Life Support Systems, Part 2. 
The Basic Form of Pontryagin’c Maximum Principle and Its Applications. Build. Sei. 
3, 81 (1970). 

2. L. T. Fan, Y. S. Hwang and C. L. Hwang, Applications of Modern Optimal Control 
Theory to Environmental Control of Confined Spaces and Life Support Systems, Part 3. 
Optimal Control of Systems in which State Variables have Equality Constraints at the 
Final Process Time. Build. Set. 5* 1 23 ( 1 970). 

3. S. S, L. Chang, A Modified Maximum Principle for Optimum Control of a System with 
Bounded Phase Space Coordinates, Automatica, 1, 55 (1962). 

4. L. D. Berkovitz, On Control Problems with Bounded State Variables, J. Math . Anal. 
/tpp/., 3,488 (1962). 

5. L. S. Pontryagin, V. G. Boltyansku, R. V. Gamkreuoze and E. F. Mishchenko, 
The Mathematical Theory of Optimal Process, (English translation by K. N. Trirogoff), 
Interscience, New York, (1962). 

6. S. Dreyfus, Variational Problems with State Variable Inequality Constraints, Rand 
Corp., Santa Monica, California, (July 1962). 

7. W. F. Denham, Stecpest-ascent Solution of Optimal Programming Problems, Rept. 
Br-2939, Raytheon Co , Bedford, Massachusetts, (April 1963). 

8. A. E. Bryson, VV, f. Denham, A Steepest Ascent Method for Solving Optimal 
Programming Problems, J. AppL Mech. f 29, 247 (1962). 

9. L. T. Fan, The Coat imsous Maximum Principle : A Study of Complex Systems Optimization , 
Wiley, New York, (1966). 

10. A. E. Bryson, Jr. ( W. F. Denham and S. E. Dreyfus, Optimal Programming Problems 
with Inequality Constraints 1 : Necessary Conditions for Extremal Solutions, J. AIAA . 
1, 2544 (1963). 

! I. J. M. Douglass, and M. M. Denn, Optimal Design and Control bv Variational Methods, 
/ <& EC Education, 57, 18 (1965). 





mm *' 

>N*.- n. “• 


4 : •»?' , r 


Modern Optimal Control Theory to Environmental Control of Confined Spaces and Life Support S\ Mem* 145 

12. J. Mrlrmiu, On Optimal Control with Bounded State Variables. (edited by (\ T. 

Lfondes) Academic Press, New York < 1967). 

13. L T. Fan. Y. S. Hwang, and C. L. Hwanc. Applications of Modern Optimal Control 
Theory to Environmental Control of C onfined Spaces and Life Support Systems, Part I 
Modeling and Simulation Build. Sci. 5, 57 (1970). 

14. A. F. Ogunye, and W H. Ray, Non-simple Control Policies for Pcactors wuh Catalyst 
Decay. Trans . Instn. Chem. Engi s. 46.T225 ( 1968), 


APPENDIX 

Derivation of equation (32) from equation { 28) 
Equation ( 28) has the form 

d* dF rr/.rw. <7, m 2 7 , 


dt ' dr 


df . [j7i<7>. , , jli, 

df 1 \j() t ( / tW* <7 ex , 

(i) 

iZi/1 . fi tiiUti LLih 

A.v 2 J j L^». Ar Af) 2 <’< 

(?.) 

(V, f.Vj J |_ Wl 

(3) (4) (I) 

Af, Ar, A/,A0, 

+ A.v, Av, + rf), A.v, Af), A.v,/ 

/ £/j i/i LI? +ih '.h + Lh. 'Jh\ 

\A.v, <v 2 A.v, Af), Av, A0 2 r.v,/ 

(3) 

_/rf Afrvj Af AO, 

\Av , + A v 2 r.v , + Af) 1 r.v , + Af), Av , / J 

L 

2 \_ '• \Av 2 Av, r.v 2 AO, r.v 2 
(2) 

(£L.£Li±}+¥i^ 

r<) 2 Av,/ * 2 \ Av 2 Av, A.v 2 A0, Av 2 


,‘Z . ££ {£• £f *2i 

Af), rv 2 ) \r.v 2 r.v, Av 2 AO, rv. 

Af Ad,Yl 

‘ r A0 1 AvJJ <A 

This equation can be simplified to 

df T 4f, -C V, AO,] 
dr " A0 2 A/ J 


+ Sj |_A 


Af i 

A»2 

Af» 2 

^ V , 

A/, 

r« 2 

AO, 

^ V| 

Af 

r«. 

Aff 2 

v i 

Af, 

<<[> 

Af), 

rv. 

A/. 

AO, 

AO, 

Av 2 

Af 

AO, 

AO, 

r.Y 2 


7i 77 \ _ / [h Cl} + Clh 

+ a) l 77,i :i \i'\.i'x l + ?o, Av, 

A/, AO , \ / if Af A.v, if i'll 
AO, Av, / \Av, A v 2 A.v, Af),A\ 


A/^ AO, <7, Afl_ 2 \ /A/i £v_, 
*A0, Av, AOj Av,/ ‘ \A v, A.v, 

A/j AO , A/, AOj ' _ / _Af + Af A.v , 

+ Af), rv 2 + rf), A.v,/ \A v, Av, Av, 


Since .v,. \ 2 . 0, and 0, are functions only of/, we 
!idve 

A.v 2 d.v 2 ^ d.v 2 d.v | ^ t 

A.v, d.v, df , dr 1 

AAv_t = dXj = dAj d.v, 

A.v, "dr dr, dr ~ ' : 

A£, d^ 

Ar ~ dr 

A Oj _ df)j 

Ar _ dr 

Atf, = dO, = dO, d^. = d»i f (A 3( 

A.v, d.v, dr / dr dr, 1 

At), dO, _ dOj dvj = dd, 

A.v 2 d.v, dr / dr dr , 

A</ 2 _ dr/j _ di/j dv, _ dtfj / 

A.v , d.v , dr j dr dr / 

r0 2 dOj dOj dv, ^ d(f_ 2 , 

A.v 2 d.v 2 dr / dr dr / 2 



obtain 



AOj ArJ 

dJT 

df 

dr +, ‘ 

rtf/,dO, 


dr 

[AO, dr 

, *^ehP t Av, 



(5) 


i i ' i 
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+ -2 

*7 2 
L<7>, 

dd, rYjddj" 
dr fd 2 dr 

<7, <7> fF ,7 

-/2-.T --/ 2 : 2 T 

( ,v : ( V 2 t \ , < \ 2 


(7) (8) 

(II) (12) 

+ /| 

-r, 

/ <7, <7, dd. 

i ^/ 2 y, + £ -r 1 , /, 
\ < v ; < d, dr / 

.‘Add, .‘Fdd 2 _ <7 

u/ r^ 2 J/ ' 1 1 rvi 



(5) 

(*» (10) 

•7 

1 <w 2 

''■MS'’* 

jT, dw, . r/. ^ _<7_ : 

1 rOj d/ 1 dr 1 ‘ r.v, 

+ ro 

2 dr 

(6) 

<7 2 dd 
+ <'(l, dr 
(7) 

f / 2 d^ 2 \ 

' j 

(8) 

<7 2 dW, ^ Ct 2 i\0, tF 

~ Zl ti)\ “dr '“ r * To, T\t ~ : 7T, 

tF (7’ dll, (7 dl/t 
_/| fv, ~(7)" dr "fd 2 dr 


/ (F CF . tF dtf, 

~{r7 l + 77 2 Ji,( ' + ^ /"' 

( F dtfs ! v"| f / (7 1 .. 

4 ^^/ / v)J +/ 4" r, l T r, /,/: 

•7i«M| / J1 i d _l , \ 

fd, dr, /i + fd 2 dr/ /j / 

(it±f n +±h. d Jb.i , 

■ 2 Uv. ™, dr / (l 

•'ti d d, \ ( t'F t'F 
<0 2 d // / \<.v 2 < v, 

*'d, d/ / ' 2 fd, dr/ /2 JJ 


or 


d£. df , . iL . # ill / . ill 

dr = dr /j ‘ 1 f.v 2 * j/l f.v 2 f.v, 

. jVj f£ 11 

7 1 ‘ 2 T.v , f .v i /2 f.v 2 fd, dr 

_ rf d^_ £/ i dd i _, 
fd 2 dr *‘fd, dr : '?0 2 dr 

Yjdd, ^ f/, dd.. £F 
** t’O, dr ~ ?I fd 2 dr ' 2 f.v 2 

, £^.1 ££^1 <A4* 

Jx f.v, fd, dr "f0 2 dr ' 

Since Fisa function of .v,, .v 2 , d, and 0 2 , 

1£ . ££ !*£• fF d£j fF dO, £^df_j 
dr f.v, dr + f.v 2 dr *fd, dr + fd 2 dr 

(A.5) 

Insertion of equation (A.5) into equation (A.4) 
gives 

dJf fF dv, jYdv, £F dfl, fF dd, 
dr' " f.v, dr + f* 2 dr *fd, dr + fd 2 dr 
(9) (10) (II) (12) 


.. <y 2 


<v, 


or 


d , . fh . £/. 

dr “ ’ f.v, 2 * 2 f.v> 1 1 fv, 

£ft dd,_. f/,dd _ 2 fr 2 
r, fd, dr *'«*«, dr /,r, f\, 

f/j dd, _ _ f/ 2 dd, , fF 
“^fd, dr “'* 2 fd 2 dr " /j .*.v 2 

fF t'F dd, t'F dd 2 
' f.v | fd, dr fd, dr 1 ) 

On the onstraint boundary, we have 

V 2 , 0 ,, 0 ,) = O 


or 


d *‘ i 0 “?l; d,, ' + ^ dw2 ^ dv ' 


+ ~d.v 2 

t\x 2 

■Jill. 

Solving this for ~ , we have 


dd, 

dr 



(A. 7) 


Inserting the above equation into equation (A.6) 
leads to 

dJf . _ f/i f f/ 2 . <7 i 


•a 


cx , 


CAT, 


, £/j . £/jdd, tf, 

'* 2 f.v, *’cd 2 d; *'fd, 

x /£lY7£L11+£L / + ) 

\^o,/ d/ 1 / 


4* r ■* 


VdtgiY'ttgiMiJSt 


'se^eej v® 2 dr +h x Jt 


■'O 



4* 


* 
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-2 


(0, d / 


cF 


?F 


f 2 - . 1 - . 


( V 


( V, 


^ d ' V— V 7^ — 2 

dr <0, \eOj \r' ; 2 <*t 

<'l <* 2 / 


(A. 8) 


Since functions, / 2 , F and ^ , , possess the con- 
tinuous derivatives, at least, to the second order, 
equation (A. 8) can be rewritten as 


f <Yi t'l 2 

dr ~ ~ 21 <lv 2 ~ 2 2 77,' 


(13) 


(14) 


£[i 

r.v, 

(15) 


-u 


Vi 

l "i 

fv, 


(16) 


. V d Jj . VdOj 
■' r() 2 d/ r *' r0 2 d/ 
(17) (17) 


or 




r.v 

(15) 


r.v, 


(16) 


ro, d^ 

(18) 


«Vi 


, . / 2 , , . „ <7 2 dfl, 

1 ' r.v , 2 2 r.» 2 ‘ rtf 2 d? 


(13) 


(14) 


(18) 


JT fF rf djlj rF dtf, 
1 (,v i ' r.v, r() 2 df : 


(19) 

<‘F 


(20) (21) 


r() 2 df 
( 21 ) 


. . y rF 

■ ~ 1 1 + ; .1 2 

r.v, r.v 2 

(20) (19) 


£-o. 

dr 

This is equation (32) in the text. 


Les conditions necessaires pour Poptimum d’un systeme dynamique dont les variables 
d’etat sont contraintes par certaines conditions d’inegalite, sont obtenues par Papplica- 
tion d’une technique de variation. Les conditions sont utilises pour determiner la 
police optimale du controle de temperature de la piece ou cabine d’un systeme de 
support de vie. On etudie encore le systeme consistant d’une cabine a air conditionne 
soumis a une perturbation de chaleur par impulsion et d’un echangeur de chateu: 
agissant comme element de controle. Le courant d’air dans la cabine est caracterise par 
le modele des deux vaisseaux en serie (2 CST en serie) completement agites. Une 
contrainte est impos6e sur la temperature environnante qui doit etre plus d’une 
certaine valeur pour certaines raisons physiques ou biologiques. 


Die notwendigen Bedingungen fiir Optimum eines dynamischen Systems, dessen 
Zustandsveranderliche durch bestimmte Ungleichheitsbedingungen begrenzt sind, 
werden unter Verwendung einer Variationstechnik abgeleitet. Es werden die Bedin- 
gungen verwandt, urn das Optimalverfahren fur die Raum- oder Kabinentempera- 
turkontrolle eines Lebensunterhaitungssystems festzulegen. Das System wird wieder 
untersucht, welches aus einer klimatisierten Kabine besteht, die eincm Warmes 
torungsimpuls und einem Warmeaustauscher ausgesetzt wird, welcher als Kontroll- 
element dient. Der Luftstrom in der Kabine wird durch zwei vdllig durchgeruhrte 
Reihentanks (2 CSTVin-series) im Modell dargestellt. Eine Einschrankung ist der 
Raumtemperatur auferlegt, die aus einigen physikalischen oder biologischen Griinden 
grdsser als ein bestimmter Wert sein muss. 
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Applications of Modern Optimal Control 
Theory to Environmental Control of 
Confined Spaces and Life Support Systems' 

Part — 5 Optimality and Sensitivity Analysis 

L.T. FANt 
Y. S. HWANGt 
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KANSAS’.": . 

EXPER 1 .*---*" 


The sensitivities of a cabin with temperature control which has been considered 
in the first Jour parts of this series are examined . These include the sensitivities 
to (\) parameter variation , (2) change in dimensions of mathematical models 
and (3) change in constraints on state variables are examined. 

The system is not sensitive to the variation of the parameter ( the recycle 
ratio of air) when the magnitude of the variation is small. The effect , however , 
is noticeable when the variation is large. The effect of the change of the para- 
meter ( the ratio of the time constants of the system proper to that of the heat 
exchanger) is very small. The effect of variation of the parameter ( the volume 
fraction of the first pool in the two CSVs-in-series model) on the optimal 
conditions is substantial. 

There is a small but not negligible effect of the dimensional change in the 
system equations , which is caused by neglecting the time constant of the hear 
exchanger. The complexity of the model describing the system component has a 
definite effect on the predicted performance of the system. The effect is apparent 
for the particular models considered here , which are the one CST mode i and 
the two CST's-in-series-model. 


INTRODUCTION 

THE PRECEDING parts of this series are con- 
cerned with the thermal modeling and simulation 
of confined spaces and ife support systems[l] 
and the optimal control of such systems[2-4]. 
Examination of the optimal results[2-4) naturally 
leads us to consider the deviation of a system from 
its nominal or optimal behavior. Such deviation of 
the system behavior is caused by deviation from 
their nominal performance characteristics of sys- 
tem components or other factors of the systems, 
which are often characterized by parameters of the 
system model. This is the essence of sensitivity 
analysis. 

Tomovic[5] and Takamatsu[6] discussed the role 
of sensitivity analysis in engineering problems. 

Thcv indicated that there are several areas of 

1 

i 

* "/ his work was supported by the Air Force Office of 
Scientific Research, Office of Aerospace Research, United 
States Air Force, Under Contract F 44620-68-0020 (Themis 
Project), and NASA Grant Under Contract NGR-17- 
001-134. 

t Institute for systems design and optimization, Kansas 
State University. Manhattan, Kansas. 


sensitivity analysis. While knowledge of the sens- 
itivity of the performance of a system as predicted 
by its model to parameter variation is important, 
there are other aspects of sensitivity analysis w hich 
are important for a particular problem or system. 

These are (I) sensitivity to change in dimensions of 
the mathematical model representing the system, 

(2) sensitivity to transition from the continuous 
model to the discrete model in describing the 
system, (3) sensitivity to the influence of various 
functional blocks (system components) which 
comprise a system, and (4) sensitivity to change in 
constraints, Tomovic[7] discussed the contributions 
sensitivity analysis can make in analyzing the 
stability of a process. Demski[8] discussed the 
broad applications of sensitivity analysis in en- 
gineering and management sciences. Books by 
Pagurek[9] and Sage[I0] arc suggested references 
for sensitivity analysis of control systems. 

Here we shall make use cf the results presented 
in the first four parts of this series[I-4] to demon- 
strate the sensitivity to (l) parameter variation, 

(2) change in dimensions of mathematical models 
and (3) change in constraints. 

J|J5CEDING PAGE BLANK NOT FILMED 
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SENSITIVITIES TO PARAMETER 
VARIATION AND CHANGE IN DIMENSION 
OF MATHEMATICAL MODEL 

In the literature pertaining to optimal control 
almost all the intensive studies in the field of sen- 
sitivity are related to the evaluation of the sensitivity 
of performance of a system, as characterized by its 
model, with respect to small parameter varia- 
tions^]. The specific values of the parameters used 
for design and control will differ to some extent 
from the actual values. Therefore, it is of practical 
importance to the process designer to know how 
sensitive the process designed by him is to these 
parameter uncertainties which may be due to, for 
example, the environmental and aging effects, the 
choice of a mathematical model both for the con- 
trolled system and the controller, and the measure- 
meins. Suppose that the value estimated for a 
parameter differs by 10 per cent from the true value. 
Does deviation of this magnitude significantly 
affect the optimal design of the process? The 
sensitivity analysis used to attempt to obtain 
quantitative answers to this question is thus an 
integral part for the complete optimal design of a 
process. 

Table 1 and figures 5 and 6 in Part 1 [1] show the 
effect of variation of the parameter r, (the recycle 
ratio of air) on the optimal conditions. It can be 
seen that the system is not sensitive to the variation 
of this parameter when the magnitude of the varia- 
tion is small. The effect, however, is noticeable 
when the variation is large. Table 2 and figures 3 
and 4 in Part 2[2] indicate the effect of the change 
of the parameter r (the ratio of the time constants 
of the system proper, cabin or room, to that of the 
heat exchanger). This effect is very small. Table 3 
and figures 5 and 7 in Part 2[2] show the effect of 
variation of the parameter r tl (the volume fraction 
of the first pool) on the optimal conditions. This 
effect is substantial. To illustrate this aspect of the 
sensitivity analysis, the dimensionless room tem- 
peratures as a function of the dimensionless time 
under the optimal conditions presented in the 
previous articles of this series are summarized in 
figure 1. Curves 1 and 2 represent the change of 
the dimensionless room temperature as a function 
of time for the system with one CST room or cabin. 
Curve 1 is for the system with the heal exchanger 
having a negligibly small time constant (r 2 — ► 0, 
t x « 50s). Curve 2 is for the system containing a 
heat exchanger with small but not negligible time 
constant (t 2 ** 5s, t t m 50 s). Comparison of 
Curves 1 and 2 indicates that there is definitely a 
small but not negligible effect of the dimensional 


change of the system equation which is caused by 
neglecting the time constant of the heat exchanger. 
A similar conclusion can be obtained by comparing 
Curve 3 and Curve 4, which are for the systems 
represented by the two CST's-in-series model. 
Comparison of the group of curves. Curves 1 and 2. 
with the group. Curves 3 and 4, shows that the 
complexity of the model describing the system 
component (room or cabin) has a definite effect on 
the predicted performance of the system. It can be 
seen that such effect is substantial for the particular 
models considered here, which are the one CST 
model and the two CST's-in-series mode). 



Fig . 1 . The sensitivity to change in dimensions of the 
mathematical model. 


THE SENSITIVITY TO CHANGE 
IN CONSTRAINTS 

The system sensitivity to changes in constraints 
imposed on the system, more specially, imposed on 
the state variable (temperature) of the system is 
discussed here. 

For this purpose, results presented in Part 4 of 
this series(4] are summarized in figure 2. Note that 
the systems considered are all represented by the 
two CSTs-in-series model (with equal size tank). 

Since the constraint is imposed on , (dimen- 
sionless temperature of the first compartment ot 
the model), naturally the effect of the change of 
constraint on this state variable cannot be neglected. 
However, the effect on the dimensionless tempera- 
ture of the second compartment, which is also the 
exit temperature of air from the room or cabin, is 
negligibly small. The effect of the change in the 
constraint on control policy is also very appreciable 
as indicated by the plot of 0 vs. t in the same figure. 
These observations are valid for the particular 
model considered and for the particular values of 
the model parameters employed here. 
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Fig, 2, The sensitivity to shift of the constraints of the 
mathematical model. 


CONCLUSIONS 

it should be evident that thorough consideration 
must be given to numerous aspects of the system in 
order to achieve a meaningful sensitivity analysis. 
The following must be considered in order to 
obtain the desired information. 

1 . Sensitivity to parameter variation. 

2. Sensitivity to change in dimensions of the 
mathematical models. 

3. Sensitivity to change in constraints. 

4. Sensitivity to transition between continuous 
and discrete models. 

5. Sensitivity to the influence of the functional 
blocks of a system. Items 1, 2 and 3 have been 
considered in this paper; items 4 and 5 will be 
briefly discussed below. 

In certain cases, an alternative may exist in 
representing the model either by a continuous 
model or a discrete model. If the predicted behavior 
of the system is very sensitive to a particular type 
of the model, use of an appropriate model becomes 
important. 

Complex systems generally consist of several 
functional blocks, stages or units. Complex chain 
reactions may follow alternative reaction paths and 
produce different intermediate reactants. The sen- 
sitivity of the entire system or process to variation 


in the types of functional blocks which are con- 
tained in tiie system and to the relative locations of 
the functional blocks is called the structural 
sensitivity[5]. 

In this sequence of five short articles, we have 
mainly resorted to Pontryagin’s maximum principle 
and variational techniques to determine optimal 
temperature control policies of several fairly simple 
but typical life support systems. It is obvious that 
the maximum principle and variational techniques 
do not constitute the entirety of the modern control 
theory nor are the systems with temperature con- 
trol the only type of life support systems. There are 
many facets to the modern control theory and there 
exists a wide variety of life support systems. For 
example, dynamic programming, originated by 
Bellman[l 1-13], has been and is being employed 
widely in solving optimal control problems. Its 
techniques and applications constitute a significant 
portion of the modern control theory. In life sup- 
port systems humidity control and pressure con- 
trol must often be provided besides temperature 
control and some life support systems are comprised 
of partially open spaces. It cannot be denied, 
however, that the maximum principle and varia- 
tional techniques are major tools of the modern 
control theory[10,14,15] and that the temperature 
control system is the most vital component of 
practically every life support system. We believe 
that singling out particular but important techniques 
and applying them to fairly simple but significant 
samples faci itate presentation and understanding 
by readers of the basic aspects of the modern 
control theory and its applications to the control 
of life support systems. 

It is well known that a majority of air condi- 
tioning systems and temperature contro lers for 
life support systems works on the on-off or bang- 
bang principle. It appears, therefore, that the 
modern optimal control theory is very much suited 
for such systems. Admittedly, application of the 
modern control theory to the control of tempera- 
ture in a small residential dwelling is the kind of 
luxury no one can afford or need in the forseeable 
future. There exist, however, many situations in 
which the duration of control and/or energy re- 
quired for control must be critically adjusted. Such 
situations frequently can be found in applications 
of life support systems in space, underwater, and 
biomedical processes, and uses of the modern 
control theory in such applications deserve senous 
consideration. 
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On examine les sensibility d'une cabine avec controle de temperature qui a ett 
consid6r£e dans les premieres quatre parties de cette sdrie. Elies comprennent les 
sensibilites (1) uux variations de parametres (2) au changement de dimensions de 
modules mathematiques et **) au changement de contraintes sur les variables d^tat. 

Le systeme n'est pas sensible a la variation du param^tre (le rapport de recyclage 
d’air) lorsqu^ la granduer de la variation est petite. L'eflet est cependant important 
lorsque la variation est grande. L'effet du changement du param^tre (le rapport des 
constantes de temps du systime lui-meme a celui de Techangeur de chaleur) est tr£s 
petit. L'eflet de la variation du param^tre (la fraction de volume du premier bassin 
dans le module des deux CST en s£rie) sur les conditions optimales est sustantiel. 

II existe un eflfet petit mais non n^gligeable du changement dimensionnel dans les 
Equations du systeme, qui est do k la constante de temps de rychangeur de chaleur 
6tant negligee. La complexity du modile decrivant le composant du systeme a un 
effet distinct sur la performance pr£vue du systeme. L’effet est apparent pour les 
modules particuliers consorts ici qui sont le module k un CST et le module a deux 
CST en s^rie. 


Die Empfindlichkeit ciner Kabine mit Temperaturkontrolle, welche in den ersten 
vier Teilen dieser Serie ins Auge gefasst wurde, wird untersucht. Man schliesst ein 
Empfindlichkeit gegen (1) Parameter&nderung, (2) Anderung in Dimensionen mathe- 
matischer Modelle und (3) Anderung in Begrenzung der Zustandsveranderlichen. 

Das System ist nicht gegen Anderung des Parameters (Luftkreislaufverhaltnis) 
empfindlich, wenn der Grad der Anderung klein ist. Die Wirkung ist jedoch merkbar, 
wenn die Anderung gross ist. Die Wirkung der Anderung des Parameters, (das 
Verhaltnis der Zeitkonstante des eigentlichen Systems zu der des Warmeaustauschers) 
ist sehr klein. Die Wirkung der Parameteranderung (der Raumbruchtcil des ersten 
Bchalters in dem zwei CST’s-in-serics Model!) auf die Optimalbedingungen ist 
betr&chtlich. 

Es trgibt sich cine kleine, aber nicht unbedeutende Wirkung der Dimensions- 
indet ung in den Systemgleichungen, die durch Vernachlissigung der Zeitkonstante des 
Warmeaustauschers verursacht wird. Die Komplexit&t des Modells, das die System- 
komponente beschreibt, hat eine bestimmte Wirkung auf die vorausgesagte Leistung 
des Systems. Die Wirkung ist offensichtlich bei den hicr dargestefhen besonderen 
Modellen, welche das eine CST Modell und das zwei CSTVin-series Modell sind. 
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ENVIRONMENTS. CONTROL OF CONFINED SPACES 
AND Li.FE SUPPORT SYSTEMS* 

L. T. Fan, Y. S. Hwang, and C. L. Hwang 
Institute for Systems Design and Optimization 
Kansas State University, Manhattan, Kansas 66502 


Abstract 


Mathematical model of an environmental control system which consists of a con- 
fined space or cabin, a heat exchanger, and a feedback element such as a thermo- 
stat are presented. The performance equations of the system, which represent 
the dynamic characteristics of the air-conditioned cabin (the system proper) and 
the heat exchanger (the control element of the system), are derived. In the 
basic model the flow of air in the confined space is considered to be in the 
state of complete mixing and the disturbance is caused by an impulse heat input. 
The flow of air in the confined space or cabin characterized by the two com- 
pletely stirred tanka-in-series (a CST's-in-series) model is also considered. 
Pontryagin's maximum principle, which is a keystone of the modern optimal con- 
trol theory, is applied to the determination of optimal control policies of the 
temperature control of the life support systems. 


1. INTRODUCTION 

This paper contains results of the original in- 
vestigation on the environmental control of con- 
fined spaces of life support systems or more 
specifically the temperature control of life 
support systems by means of the modern control 
theory. A life support system is a system for 
creating, maintaining, and controlling an environ- 
ment so as to permit personnel to function 
efficiently. The control of temperature is 
probably the most important role of the life 
support system. 

The need for providing an automatic control 
system to an alr-conditlcnlng system has long 
been recognised/** 2 * It is also a well known 
fact that use of the automatic control is nec- 
essary for the life support system of a space 


(3 4) 

cabin or submarine or underground shelter. 1 
It appears that analysis and synthesis of the 
control systems for the air-conditioning and life 
support systems have so far been carried out by 
the classical approach/ 1 * 2 * 3 * ** 

The classical approach to the analysis and 
synthesis of an automatic control system is 
essentially a trial-and-error procedure or a dis- 
turbance response (or input-output) approach. 
Extensive use is made of the transform methods 
such as the Laplace transform (s-domaln), Fourier 
transform (w-domain), and s transform (discrete 
time-domain). Even though mathematics is exten- 
sively used, the classical approach Is essen- 
tially an empirical one/ 5 * 

In recent years, an approach to the analysis and 
synthesis of a control system, which is distinctly 


*This work was supported by the Air Force Office of Scientific Research, Office 
of Aerospace Research, United States Air Force, Under Contract F4 46 20-6 8-0020 
(Themis Project), and NASA Grant under Contract NGR- 17 -00 1-0 34. 
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different from the classical one, has been deve)- 

oped. Thi9 modern approach Is generally called 

the modern (optimal) control theory.^* 

9 10 11) 

* 1 It is based on the s rate-space charac- 

terization of a system. The state-space is the 
abstract space whose coordinates are tne state 
properties of the system or the variables which 
define the characteristics of the system. ^ 

This approach Involves mainly maximization or 
minimization of an objective function (functional) 
which is a function of state (plant) and control 
variables which are in turn functions of time 
and/or distance coordinate. The objective 
function is specified, constraints are imposed on 
the state and decision variables, and an optimal 
control policy is determined by extremizing the 
objective function by means of mathematical tech- 
niques such as the calculus of variations, maxi- 
mum principle, and dynamic programing.^' ^ 

This modern approach is entirely theoretical in 
the sense that no trlal-and-error is Involved in 
"adjusting the controller". 

There are reasons to believe that the classical 
approach suffices in the analyses and syntheses 
of the control systems for a majority of air- 
conditioning and life support systems because 
usually the requirements are not extremely crit- 
ical and specifications are not very tight. It 
is, therefore, justifiable that most of the con- 
trol and dynamic investigations of air- 
conditioning and life support systems, which have 

appeared in the open literature, are based on the 
(12 - 20 ) 

classical approach. There is, however, a 

certain incentive in applying the modern approach 
to analysis and synthesis of automatic environ- 
mental control systems in space crafts, sub- 
marines, underground civil defense shelters and 
certain medical facilities. In these system, 
very stringent requirements in the response time, 
control effort, and others are imposed* For 
example, the control system of a space craft must 
have an extremely small response time and further- 
more, the amount of energy required for the con- 
trol effort must be very small because of the 
weight limitation imposed on the space craft. 


In the present work, the emphases are on the use 
of the maximum principle and related variational 
techniques. Their appli- 

cations will be illustrated by means of concrete 
numerical examples. 

The examples are concerned with the temperature 
control of a life support system consisting of an 
air-conditioned cabin subject to an impulse heat 
disturbance and of a heat exchanger. The optimal 
policies of the system where the flow of air in 
the cabin can be characterized by the one com- 
pletely stirred tank model and by the two com- 
pletely stirred tanks-in-series (2 CST's-in- 
series) model are studied. 

2. PERFORMANCE EQUATIONS FOR ONE 
COMPARTMENT MODEL 

A control system usually consists of three 

elements: the feedback element, the control 

(23) 

element, and the system proper. The feedback 

element in a life support control system or an 
environmental control system may be composed of a 
thermostat, humldistat and pressure regulator, or 
any combination of these, depending on the 
purpose of control. The control element may in- 
clude a heat exchanger, humidifier, dehumidifier, 
blower, portable air-conditioner, or any combi- 
nation of these, depending on the objective of 
control. For instance, both the thermostat and 
heat exchanger are often used to control the air 
temperature inside a building. The system 
proper may be a confined space, e.g., an under- 
ground shelter, a space vehicle, a apace suit, a 
submarine or a building. 

The system considered here is shown schematically 
in Fig. 1. The confined apace may be a typical 
office located in a multi-story building or the 
cabin of a spaceship. Air or oxygen or a 
mixture of oxygen and nitrogen is circulated 
through the room or confined space via an sir 
duct by mechanical means, e.g., a blower or fan. 
Control of sir tesiperaturs in the system Is 
accomplished with a duct system. The thermostat 
In the system adjusts the position of the control 

valve of the heat exchanger in order to provide 
the desired temperature. 
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The performance equations of the svstem, which 
represent the dynamic characteristics of the 
svstem and system components will be derived. 

A. The Svstem Proper 

The following three main assumptions are made con- 
cerning the svstem proper: 

(1) Room or cabin air is well mixed, or 
stated in another way, air temperature 
within the system is uniform throughout 
at any instant in timv. 

(2) The thermal capacitance of room walls, 
floor, ceiling, and window is neglectec, 
''S well as that of anv furniture within 
the system. 

(3) Heat loss through the walls and wincovs 
is negligible. 


The performance equation nf the svstem prorer can 
be obtained bv using the continuity law or heat 
balance. Assuming that the heat disturbance is 
an Impulse form, the cabin performance equation 
becomes 


TT + V r l V r 2 T 2 +t 1 T d S( '‘> 


( 1 ) 

T - 0 at a « 0 
c 

where T c is the room temperature, T^, the tem- 
perature of the circulation air into the system 
proper, T 2 * outside air temperature, T^, dis- 
turbance temperature, t^, time constant of the 
system proper, r^, the fraction of circulation 
air, r^, the fraction of fresh air, a, the time, 
and 6(a), impulse heat disturbance function. 


In dimensionless form equation (1) becomes 



r l K l x 2 




x^ • 0 at t - 0 


( 2 ) 


B. The Control Element 

The heat exchanger which le the control clement 
of the system under consideration can perform its 
control function in various ways, for example, bv 
changing the temperature or flow rate of the heat 


transfer medium, or changing both. The per- 
formance equation of the control element can be 
obtained again by employing the continuity law or 
heat balance, which can be expressed in equation 
form as follows: 


dT QpC (T -T ) 

i +T T w w pw ^ wh wc 

2 dot i c O.pC 

1 P 


(3) 


where is the time constant of the heat 

exchanger. Note that Q p C (T.-T )ls the 
^w w pw wh wc 

amount of heat removed from or added to the 

system which can be controlled by adjusting either 

Q when p , C , and (T.-T ) are constant, or 

v w pw wh wc 

(T.-T ) when 0 , p , and C are kept con- 

wh wc w* w pw r 

stant, or both Q and (T.-T ) when p and C 

H w wh vc w pw 

are constant. In order to have a mathematically 
neat form, a hypothetical temperature is 
defined 


T 
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0 p c 

w w pw 


(T 


wh 


- T )/Q.pC 
wc 1 p 


(4) 


Inserting this definition into equation (3) yields 


2 da 


T 
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( 5 ) 


or in dimensionless form 


]2 

T 1 
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x 1 K 4 


K a (K 2 0 + k 3 ) 


C. The Feedback Element - Thermostat 


( 6 ) 


Here we simply assune that the sensing element 
measures the room temperature Instantaneously and 
that there is no accumulation of heat in the 
element, or for simplicity, it will be assumed 
that the sensing element is the aero order element 
with its time constant, t^> equal to aero. Ref- 
erence 23 gives a detailed explanation of the 
response of the thermostat. 

3. PERFORMANCE EQUATIONS FOR TWO 
COMPARTMENTS MODEL 

Next, let u* consider the case In which air in the 
room or cabin is no longer In the state of com- 
plete mixing. Specifically, vc shall consider the 
ca*e in which flow of air In the room can be 
characterised by two completely stirred tanks (or 
pools or compartments) (2 CST* a) -in-serlcs modal. 


1 77 


The following assumptions must be odd* d to those 
already made for the system proper In the pre- 
ceding section: 


a) The room is divided into two well mixed 

compartments in series. Volume of each 

pool is denoted by and V^» and the 

temperature in each pool is denoted by 

T . and l 
cl c2 

b) Backflow of air from the second com- 
partment to the first compartment is 
negligible. 

c) Disturbances are equally distributed over 
the system. 

d) Fresh air comes into the first compartment 
at a constant flow rate, while exhaust air 
is released from the second compartment at 
a constant flow rate. 


The schematic diagram of the system is shown in 
Fig. 2. The performance equation for each pool 
can be obtained by using the transient heat 
balance around each compartment. Thus, for pool 1, 
we have 


^cl 

l ll da 


+ T 


cl 


,r lV r 2V T 


11 


t u T d 6(a) 


(7) 


T - 0 at 
cl 


dT 1 

T 11 + T cl " r l T i + r 2 T 2 


T cl " *clO 


at t - <T 
Similarly, for pool 2 we have 


<iy ll ^ 

Ti r i Oi i ' * 1 1 > ' -• '*i 

2 + 3 1 i U> 

(9) 

iU 

(it 12*12 * '*21*1 1 

. , <t) 

. > 

( 10) 

d< 2 

dt r *2 ' '*42 x 12 ‘ a 5 

a e 

Ml) 


4. OPTIMAL CONTkOI. OF ONE COMPARTMENT MuDlL 

Suppose that the dynamic behavior of a life 
support system consisting of an ai r-condi t lened 
room or cabin subject to the impulse heat dis- 
turbance and a heat exchanger with negligibly 
small time constant (-^ *0)’ Then the system 
performance equation in dimensionless form can be 
obtained bv combining equations (2) and (6) and 
letting i 2 • 0. 


dx i 

•dT + r 2 x l‘ r 2 K l' r l K l K 2' - r l K l K J 


wi th 


Xj(0) * 1 

at 

t - 0 

XjfT) • 0 

at 

t - T 


( 12 ) 


where T is the unspecified final control time. 

We ' r ish to determine h so that the response of 
the system can return to its desired state in a 
minimum period of time, that is, to minimize 

s - ; T dt (13) 

0 


If an additional state variable x 2 is introduced 
as 

t 

x«(t) - J dt, 

2 0 


dT 


c2 


12 


‘12 da c2 A cl J x 12 *d u 


T c2 • 0 « 


dT c2 

t 12 da + T c 2 “ T cl 


T c2 ’ T c20 


at a ■ 0 

or In dim«nslonl«ss form 


it follows that 

dx, 

- 1. x 2 (0) - 0 (W 

The problem Is thus transformed into that of min- 
imizing x 2 (T). 

(7 8) 

According to Pontryagin’s maximum principle, 
the Hamiltonian is 


I7S 


H[z(t), xvO. f '(t)] 
dx^ dx^ 

" 2 1 "dt" + Z 2 ‘dF 


Z l^" r 2 x l + r 2 K l ' r l K l K 2 P ‘ r l K l K 3 

l + z 2 (15) 

The components of the adjoint vector 
by 

are defined 

dz l )H 

dt .Xj ’ r 2 Z l 

.16) 

dZ 2 3H n its i 

~dF °* z 2 <T) ■ 1 

(17) 

Solutions of equations (16) and (17) 

are 

r 2 C 

z A (t) - Ae 2 

(18) 

z 2 <t) - 1, 0 < t < T 

(19) 


where A is the integration constant to be deter- 
mined later. Inserting equation (19) into 
equation (15) yields 


In the case where the coefficient of 1 in 

equation (21) vanishes, we have the possibility 

of singular control. For singular control, 

the control variable takes on values which are 

intermediate to '• and f.* . ; hence the name 
max min 

intermediate control is also used in place of the 

singular control. Also inertialess control 

will be considered. An inertialess controller 

h<,s the abLlitv to shift from 0 to “ . in- 
max min 

stantaneously and vice versa. 

The maximum principle now requires that the 
system equations, equations (12) and (14), be 
integrated simultaneously with the adjoint 
equation (16) so that the two-point boundary con- 
ditions 


x x (0) 

- 1, 

x 1 (l) - 0 

X 

K) 

o 

- 0, 

x 2 (T) * undetermined 

* x (0) 

■ undetermined, 

z^(T) * undetermined 


H * -r 


" r 2 z l x l + r 2 K l*l ~ t l K l K 3*l + 1 


( 20 ) 


Therefore, the switching function, H*, the 
portion of H which depends on 0, is 

H* * ->’ 1 K 1 K 2 i 1 0 (21) 


Note that minimization of the Hamiltonian with 
respect to : corresponds to that of the objective 
function. Equation (21), however, indicates that 
the minimization of the Hamiltonian with respect 
to n is equivalent to that of the switching 
function. Thus, minimization of the switching 
function corresponds to that of the objective 
function. Equation (21) also indicates that for 
the switching function to assume the minimum value, 
9 must assume its minimum allowable or its maximum 
allowable value depending on the sign of the co- 
efficient of b. 


e - e • 1 

max 

if 

- r i K iVi < 0 

9 • 0 . - -1 

min 

if 

’Wfi ' 0 


( 22 ) 


Time optimal control policy of this type is of 
bang-bang tvpe.^* ** 


are satisfied. For this minimum time problem 

extremum of the Hamiltonian must vanish at every 
(7 8) 

point of its response.' * 

In order to bring the initial deviated state 

Xj(0 + ) * 1 to the final desired operating state 

Xj(T) * 0, we intuitivelv reject the control 

0 - 9 , * -1 (which corresponds to the minimum 
min 

cooling action). Equation (12) can be integrated 
with the conditions 


e 


e 


max 


1 


and 


x x (0) - 1 at 


(23) 

(24) 


as 

"V i 'V 

+ 7^ (r 2 K l- r l K l K 2' r lW (l -* ) 


-r.t -r-t 

•• 2 + A (1 - e 2 ) 

r 2 


(25) 


where 

n - r 2 K x - r^Kj - (26) 

The Integration constant A In equation (18) can 
be determined by utlng the condition that minimum 
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9 m 




H is zero for all the protest tiru. m ti-.e or U "mi 
control. At t - G + , u>? have f rer. equations f i *n t 
(20), (23) and (24) 


In- mOiuiio th it the ham 1 tom an is kept at 
?ero \i fur i-oint it its response in this ^im • 
" 'i. ti~e pr« hit- . For 


r 


rS 

m 


A - Zj(0 ) 


-1 

- r„ 


ind 


z x it) 


(27) 


Equation (27) implies that z(t) will not change 
sign since z^(t) * 0 only when t approaches nega- 
tive infinity, or in other words, control will 

not shift from 0 to e . (or from 0 . to ). 

max min min max 

Therefore, this problem is a particular case of 

bang-bang control which has the bang part onlv. 

The optimal control policy starts with T and 

r fltflx 

then keeps operating at the upper bound of T 
until the final desired state is reached. The 
final control time can be obtained from equations 
(20) and (33) together with the final condition 

0 at t * T 

as follows 


x x (T) 


H - z^TH-r^T) ♦ n] + 1 • 0 


or solving for z^CT) 


z,(T) - -i 
1 n 


Also we have, from equation (27), at t ■ T 


t^T) 


si. 


r 2 T 


n - r„ 


(28) 


(29) 


Solving for T from equations (28) and (29) gives 

i n - r„ 


T - -r U(- 

r 2 




(30) 


This solution may be verified by inserting it into 
equation (25) aa 


r . - u . H 

i 

Kj - 0.5 
L ■ 1.5 


i 


0.2 


Siave 

f run 

equations iJ}), (-7) anu ( 10) 


z ^ t ) 

1 

i. 

0.2t , _ 0.2t 

j f 3 (J . 't>9e 

( \\) 

>»(t) 

* 6. 

- -0.2t 
je - 5 . : 

( 32) 


T » 0.8353 

and f rom equation (3!) 


’1 


1.3 

J 

i.'i 


0. 7b9 
0.909 


t » 0 
t - T 


Equations (31) and (32) ire graphically shown in 
Fig. 3. The state variable x^ approaches asvmp- 
toticallv to the final state, the control vari- 
able ■ remains at unitv unt* 1 the final state is 
reached, and the adjoint vector increases asymp- 
totically. The optimal control tan be verified 
bv computing H at an arbitrary point, sav 0.3, of 
the time coordinate as follows: 


t - 0.5 

Zj(t) - e' 0,1 /1.3 


Xj(t) • 6 , 5 e 


* 0 . 1 


3.5 


and 


H » Zj( t) l-r 2 * l + r^ - - r i K i K 3 ^ f 1 

’ Vi l-°a(6.5e" 0,i - 5. 5) + 0.2x0. 5- 1.21 + 1 


XjO) 

“ r 2 T - r 2 T 
- • 2 ♦ ~ U-* 2 ) 
r 2 


«xp(-r, f- *n(— — t)l 

* *2 n 

♦ 7 - <1 -•xpl-r, ~ tn(— - — -) ] ) 

r 2 2 r 2 n 


This computation shown that the minimum value of 
H is zero at everv point of this continuous pro- 
cess . 


Four cates with different cooling capacities of 
the heat exchangers are considered here. T 
and T 


r min 
four cases: 


r max 

take the foliating values for these 


1 to 




Case 

1: 

T 

r 

m 

max 

30’ C 

T 

r 

min 

0’C 

Then, the Man'll Ionian Is 


Case 

2: 

T 

m 

20*C 

T 

m 

0’C 

HU, x, <■) 




r 

r aax 


r 

min 




Case 

3* 

T 

m 

10’C 

T 


o°c 

z ll <-r il x ll + n 13‘*42 X 12* a U a 5 

.l a 6 , + a I2? 



r 

max 


r 

min 




Case 

4: 

T 

m 

5°C 

T 

m 

O’C 

+ z 12 ( - r 12 x 12 + a 21 X ll )+Z 3 

(38) 



r 

max 


r 

min 





The numerical solutions for these cases are 
obtained from equations (25), (27) and (30), and 
are tabulated in Table 1. 

5, OPTIMAL CONTROL OF TWO COMPARTMENTS MODEL 

Let us again consider a life support system con- 
sisting of an air-conditioned room and a heat 
exchanger as in the preceding example. However, 
suppose that the flow of air <r. the room can be 
characterized by the two CST ’s-in-series model. 
Again assuming that the heat exchanger has a 
neg 1 igibly small time constant (t^ 0), the 

system performance equations, equations (9), (10), 
and (11), become 

dx 


dt * r U x il 


a ll a 42 *12" a ll a 5 * a ll a 6 +a 12 


d x 12 

dt r 12*12 * a 21 x ll 
The initial and the final conditions are 
x 11 (0 + ) • x 12 (0 + ) *1 at t ■ 0* 

x n <T) ■ XjjO) * 0 at t - T 

where T is unspecified. Ue are to Biniaite 


(33) 

(34) 

(35) 


According to the definition of the adjoint vari- 
ables, we have 


dz 


11 

dt 


♦ x u " r U Z ll * a 21 Z 12 


(39) 


dz 


12 

dt 


jH 

3x 


12 


“ a il a 42 *11 * r 12 / 12 (4 * 0) 


dt 


T~ - 0. « 3 <*> ’ 1 


((*1) 


‘"he solution of can be obtained from equation 
(41) as 


* 3 <0 - 1 , 


t < T 


(42) 


Equation (38) can be rewritten as 
H(z, x, e) 

■*ll ( - r n x ll + *n a 42 ,x 12- a ll a 5’ e - a ll a 6 ,+a 12 ) 


+ * r ' -r 12 x, 2 + »21 x ll ) + 1 
Therefore, the switching function H* is 

LI* 


H" 


" *11*5**11' 


(43) 


(44) 


Inspection of H* shows that the optimal controller 
should be of s bang-bang type. The control action 
for this problem, however, is constraintd In such 
a manner that 


s * 0 - <J‘ (36) 

Introducing an additional state variable 


we have 

Zl. 

dt 

The problem is thus transformed into that of min- 
imising Kj(T). 


lei < 1 


(45) 


The conditions for which the Hamiltonian la to be 
minimum are 


■ </ dt * 


6 ■ e -x * 1 

If 

■ a n a 5 *n ‘ 0 





(46) 



9 • e .i„ • - 1 

if 

‘•n's’*!! * 0 

1, x-(0) • 0 

(37) 

In order to bring 

the 

Initial deviated atate, 


* n (0*) • *i 2 (0 + ) - 1 at t • 0*. to the final 
desired operating state, x^tT) • x^T) * 0, at 
t • T, we intuitively employ the control action 


It! 



* 


'f 


1 'maximum cooling action). Sub- 


stituting this value of - into equations 1 3 3 ) and 
(34) and then eliminating x^, we have 


A 


+ + r ) — — +(r r -a a 'a )x equations (33) and (34). 

2 11 1 T dc ir ll 12 11 42 d 2V 12 


dx , 


r 12 * [ 11 ~ 11 K ~ a 21 
'll ' * 12 


For 0 * -1, x^(t) and x^ 2 (t) are solved bv using 


dt 


*11*5 a 21 + "ll*21*6 - a 12 a 2r° (i7) 


Solution of x^ can be written in the form 


'll 1 V 12 t 

Xp*Ac + Be ♦ K, 0 ^ t ^ t R 


(48) 


x n (t) "4; I(1 u +r i2 ,D i e 11 

12 C 

+ 0 12 + r 12 )D 2 e * r^K’j. <5C> 


t ' t ' T 

s — 


;■ :c 




where ^ and * ^ are roots of the characteristic 
equation 

,2Mr U +r 12 ) ‘ + < r ll r 12- a ll a 21 a 42 ,) “ 0 


and 


and 


*11*5*21 **11*21*6 '*12*21 

i | ‘ 

*11*42 *21 ‘ r U r 12 


Inserting equation (48) and its derivative to 
equation (34) and solving for x^ yield 


n 

'4 t(X n + r 12 )A« Xut MV 12 *r u )B, Xl2t >r 12 K]. 


0 < t < t 


(49) 


Constanta A and B in equations (48) and (49) can 
be determined by employing the initial condition, 
equation (33) and Cramer 'a rule as follows: 


A • 


8 * 


*21" r 12 lt 

r 12 * ' 12 

1 - K 

1 

'12* X ll 

r 12 + X 12 

1 

1 

*21 - r 12 • 

X 12 * V 12* 

x u ~ 

X 12 

*12 * X U 

•21 - *1 

1 

1 - K 

X il 

~ X 12 


A . ^ t * i2 C 

x p (t)-D ie A *D 2 e +K\ t s < t : T (31) 


where 


K ' . *11*21*6 ~ *11*5 *21 ~ *12*21 

*11*21*42' ‘ r 1 1 r 1 2 

Constants and can be specified by noting 
that and x J2 are continuous with respect to 
t. We obtain from equations (49) through (31) 
at t • t 


i..t 

x 12 (t s ) • V 1 “ + V * * K ’ 


A , . t A t 

* 11a . I, 12 s . „ 

Ae ♦ Be + K 


(52) 


and 


* u ( t s ) 

1 ^ 'ii 1 * 

* 7^ l(> n * r i2 )0 i e 

V 1 . 

* (X 12 * r 12 )D 2* 4 r 12 K,) 

1 ^ll 1 # 

• r IU 11 * 


-21 


'll ‘12' 

♦ (X ♦ r l2 )>* 12 * + r 12 IC] 


(53) 


Solving for 0^ and Dj from thaat aquations leads 
to 


D i ' A ■ r x a 


°2 ’ * ' E 2* 


" X U*» 


’ X 12*t 


( 54 ) 

(55) 


l«2 



where 


6. CONCLUDING REMARKS 


E 


1 


X 12 (K’ - K) 
X 12 * *11 


E 


2 


* U (K' - K) 
X 11 " X 12 


We see that D. and D. are functions of t . The 
12 s 

value of t and that of T can be obtained by 
s 

using the final conditions 

x u (T) - x 12 < T > “ 0 at 1 m T 


Equations (50) and (51) thus become 


n X 1I* X 12 T . 

D^e + D^e + K 


(56) 


1 X 11 T 

^l (x n + r i2>V 

A 

+ (A 12 + r 12 )D 2 e +r l2 K*l-0 (57) 

Eliminating T from these equations and letting 

X K' 

11 * 

E 3 " X 

±2 a 11 


K*X 


12 


4 \ n - X 12 


we obtain 


A - E,e 


hi*. 


X 2 E- 

) *(— 


B-E^e 


^12^ 


11 

) 11 (58) 


t g can be solved from this equation by a trial 
and error procedure. Then D^, and T can be 
calculated directly from equations (54) through 
(56). 

The solutions of this problem are shown sche- 
matically in Figs. 4, 5 and 6 and are tabulated 
5n Table 2. The solutions are very similar to 
those of the preceding example. However, one 
distinct difference between the response of the 
dimensionless room temperature in this problem 
and that in the preceding one la that the 
dimensionless room temperature can become nega- 
tive in this problem while it can not be below 
taro in the preceding one. 


By now readers should be able to realize that the 
maximum principle has a certain advantage over 
other modern optimal control techniques. It is 
that it can be used to evaluate the number of 
switching points of the bang-bang control policy 
via the switching function and adjoint vectors. 
Two examples given in this article take advantage 
of this rule. Furthermore, the maximum principle 
can be applied not only to the system with linear 

performance equations but also to those with non- 

(24) 

linear performance equations. Bellman proved 
theoretically that the number of switching points 
is one less than the dimension of the problem for 
linear systems. However, this theory cannot be 
applied to non-linear systems. 

It is worth noting that other forms of the 
objective functions can be considered. For 
example 

S » / [x ) 2 dt 

0 1 

S - / (a 4- b.(x-) 2 ldt 

0 

T 2 

s - / ter dt 

T 2 
S - / [a + c(e) ]dt 

0 

T 2 2 

S - / [a + b.(x.r + c(er]dt 
0 1 1 

T 

S - / ib.(x ) 2 + c(e) 2 ]dt 
0 11 

T 

s - / leldt 
0 

The objective functions have different physical 
significance.^* ^ 
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Fig.3. Optimal control policy and system response 
Fig. I Air-conditioned room of the one CST mode) withT.,-0 



Fig. 2. Schematic expression of a room 
represented by the two CST's-in- 
seriet model 







Fig 4 Phase plane plot for Cose I of the two 
CST’s -m -series model withT 2 -0 ond 

different values of r M 



Fig 6 Optimal control policies and system responses 
of Cose l of the two CST s-m- series 
model withT 2 «o ond different values of 

r » 


FiflS.Phose plane plot for different case* of 
the two CST’s- in -series model with 
T.«0 ond r..« 2 . 
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NOMENCLATURE 


r Kj/K 4 


r K 4 /K x 
rK 2 K, 
r K ;j % 


r l K 11 r ll /K 4 


r l r 2 K 11 
f d K U /T 2 r U 
f 12 K 12 /K ll 

T d K 12 /T 2 r 12 
r K 4 /K 12 

V K 12 

Integration constant 

Integration constant 

Integration constant 

Integration constant 

Specific heat of air in Kcai/Kg °C 

Specific heat of coolant in Kcal/Kg °C 

0(t), z( t) ] - Hamiltonian function 

The portion of H which depends on 0 

r *2 - *1*5 - *1*6 
r - *1*4 

r * 2 ♦ .j-j - tl . 6 


2T^ ' r max r min 7 


Tq (T r max + T r min) 


Ql + Q 2 » flow rate of air in the system 
proper in m^/sec 

Air flow rate by circulation air in 

mVsec 

Flow rate of fresh air in mVsec 
Flow rate of coolant in m^/sec 
T 1 

— , the ratio of time constant of 
2 system proper to that of heat 
exchanger 


Ql + Q 2 


Qi + Q 2 


the fraction of circulation air 


the fraction of fresh air 


Performance index 

— , dimensionless time 
T i 

Reference temperature in # C 

Room temperature in °C 

Disturbance temperature in *C 

Temperature of incoming circulation air 
in *C 

Initial time 
Switching time 

Inlet temperature of coolant in # C 
Outlet temperature of coolant in # C 
Outside air temperature in “C 
Final time, dimensionless 

(t - t ), room temperature in *C 

c a 

Room temperature at a ■ 0 + in *C 
Temperature of pool 1 in *C 
Temperature of pool 1 at a • 0 + in *C 




c2 


Temperature of pool 2 in °C 


T c20 " 

Temperature of pool 2 at a = 0 + 

j 

T d ■ 

(t d - t a ), disturbance temperature in °C 

a f 

T 1 * 

(t^ - t ), temperature of the cir- 
culation air into the system, 
in °C 

*( 0 
p 

T i0 ’ 

Temperature of the circulation air into 
the system at a « 0+ in °C 

p w 


Op c (T . - T ) 

'Si W pV Wh WC 

0 

1 * 

r 

-t f nyporneticai 

^1 P p temperature 


i 

u-t 

u 

H 

Final steady state value of 

T 1 

T - 

r max 

Upper hound of T^ in °C 

T 11 

T r min 

Lower bound of in °C 

T r0 " 

Value of T f at a ■ 0 in °C 

T 2 

T 

wc 

‘wc - ‘c in #C 

T 12 

T wh ■ 

‘wh - ‘a 10 * C 


T 2 ' 

(t^ - t fl ), outside air temperature 

e 

« 

U 

v-' 

O 

Step heat disturbance function 


v l • 

3 

Volume of room in m 


V 11 - 

Volume of pool 1 of two completely 
stirred tanks in series model in 

e(t) 

$(ct) 

a 

n 

> 

Volume of heat exchanger in in'* 

n 

V 12 ' 

Volume of pool 2 of two completely 
stirred tanks in series model in m^ 

x n 

Xj(t) - 

T 

c 

= — , dimensionless room temperature 
cO 

X 12 

XjtO “ 

T i 

-= — , dimensionless temperature of the 
A i0 circulation air 


x ll 

T cl 

~ — , dimensionless temperature of 
T clO pool 1 

l. 

x 12 “ 

T c2 

« , dimensionless temperature of 

c20 pool 2 

2. 

* 4 <*> ■ 

Adjoint variable 

3. 


CREEK LETTERS 
Time in sec. 

Final time in sec. 

Impulse heat disturbance function, sec 
Aii dens i tv in Kg/m^ 

Density of coolant in Kg/m^ 

T d 

, dimensionless disturbance tern- 
1 2 perature 

v i 

r — — — , time constant of the system 
U 2 proper in see. 


*11 


<>1 + 0 2 


, time corstant of pool 1 in sec. 


zr- , time constant of heat exchanger in 
M sec. 


nz 


q 1 + q 2 


, time constant of pool 2 in sec. 


T - 4(T +T 1 ) 
r 2 r max r min 


r max 

i(T + T 

2 r max r 

min 

+ 1 

at T - T 



r r 

max 

1 

at T * T 

min 

r r 


, control 


Optimum value of 0(t) 

Heat disturbance function 
Defined in equation (26) 
Constant in equ? on (48) 
Constant in equacon (48) 


REFERENCES 


and Air Conditioning," pp. v-vi, McGraw-Hill, 
New York, 1953. 

Uchida, H. , et al., "Automatic Control of 
Air Conditioning (in Japanese)," pp. 7-44, 
Scientific Technologv Center, Tokyo, 1963. 

Webb, P. f J. F. Annia, and S. J. Troutman, 
"Automatic Control of Water Cooling in Space 
Suita," NASA Report CR-1085, National Aero- 


188 



nautus -iiul spau Ait" i m i r 1 1 i on , i «n uk i ..p , 
0. < . , 19bB. 

4. Vaughan, K. L. , H. M. S te-Jicnes , unit R. s. 
Burkei, "i.enri-i 1 izi ii Lir. i r% n.,.c , nc.ii Control 
«irui Life Support Svs f-ortrun I’ro^ran - 
Vn], 1," Douglas Report >M-49.*0 3, Santa 
Monica, Calif., Mav 19fo. 

5. Tou, J. C., "Modern Control Theory," pp. 5- 
12, McGraw-Hill, New York, 1964. 

6. Bellman, R. , "Some \istas of Modern Mathe- 
matics," pp. 1-49, U. of Kentucky Press, 
Lexington, 1968. 

7. Pontryagin, L. S., V. C. Boltvanskii, it. V. 
Gamkre lidze , and l. F. Mishchenke, "The 
Mathematical Theory of Optimal Process 
(English translation hv K. N. Trirogoff). 
Interscience, New York, 1962. 

8. Fan, L. T. # "The Continuous Maximum Prin- 
ciple: A Study of Complex Systems Optimi- 

zation," John Wiley and Sons, New York, 1966. 

9. Sage, A. P., "Optimal System Control," 
Prentice Hall, Englewood Cliffs, New Jersey, 
1968. 

10. Lapidus, L. and R. Luus, "Optimal Control of 
Engineering Processes," Blaisdall, Waltham, 
Mass., 1967. 

11. Leondes, C. T., "Modern Control Systems 
Theory," McGraw-Hill, New York, 1965. 

12. Harrison, H. L., W. S. Hansen and R. E. 
Zelenski, "Development of a Room Transfer 
Function Model for Use in the Study of 
Short-term Transient Response," ASHRAE Trans. 
74, Part 2, 198 (1968). 

13. Zermuehlen, R. 0. and H. L. Harrison, "Room 
Temperature Response to a Sudden Heat Dis- 
turbance Input," ASHRAE Trans., 71, Part 1, 

206 (1965). 

14. Gartner, J. R., H. L. Harrison, "Dynamic 
characteristics of water to air cross flow 
heat exchangers," ASHRAE (1965). 

15. Allen, R., "Time modulations control in- 
creases comfort," Part I and II, American 
Artisan, July (1950). 

16. Buchberg, H., "Cooling Load from Pre tabu- 
lated Impedances," Heating, Piping and Air 
Conditioning, February 1958. 

17. Buchberg, H., "Cooling Load from Thermal 
Network Solutions," Heating, Piping and Air 
Conditioning, October (1957). 

18. Drake, W. B,, "Transfer Admittance Functions" 
ASHRAE (1959). 

19. Chapman, W. P., "Fundamentals of Linear Con- 
trol Theory," ASHRAE J., 6 (4), 64-66 (1964), 

20. Solvanson, K. R,, "Some Control Problems and 
Their Solutions," ASHRAE J., 6, (5), 76-79 
(1964). 

21. Merriam III, C. W. # "Optimization Theory and 
the Design of Feedback Control Systems," 
McGraw-Hill, New York, 1964. 


• 1 1 1 1 < 1 , , " 1 In. * ’p 1 1 in i / j 1 1 ,»ji i ’ ) 

Domett i i Him imp Systems," Ph.D. Dis- 
sertation, University of Michigan, 1967. 

J3. I ougliui».'ui , D. R, a: d 1. H. koppt*!, ‘*sv, 

Systems Analysis and Control," Millruw-Hi 1 1 , 
Neu York, 1965. 

24, be liman , R. , I. (.lLcksberg and O, Gross, 

"On the Bang-bang Control Prob±ems," 
Quarterly Appl. Math., JL_4, 11 (1955). 

Ma Kmi 

Mjuif-TSi nr Far; ro fivoi t t,o B.F. d.tf^ree in rliern- 

ltal engineering from the National Taiwan Univer- 
sity in 1951, the M.S. degree in chemical engi- 
neering from Kansas State University, Manhattan, 
and the Ph.D. degree in chemical engineering from 
West Virginia University, Morgantown. In addition 
he received the M.S. degree in mathematics from 
West Virginia University, Morgantown in 1958. 

He joined the faculty of Kansas State University 
in 1958 where he is a Professor and Head of Chem- 
ical Engineering, and Director of the Institute 
for Systems Design and Optimization. He has 
published two books on the maximum principle and 
more than 1 30 technical papers in optimization, 
fluidization, chemical process dynamics, and 
related fields. 

Yuan-Sen Hwang 

Yuan-Sen Hwang received the B.S. degree in chem- 
ical engineering from the National Taiwan Uni- 
versity in 1966, ani the M.S. degree from Kansas 
State University, Manhattan, in 1970. He is 
currently working as a project engineer at 3M 
Company, St. Paul, Minnesota. 

Ching-Lai Hwang 

Ching-Lai Hwang received the B.S. degree in 
mechanical engineering from the National Taiwan 
University in 1953, and the M.S. and Ph.D. 
degrees from Kansas State University, Manhattan, 
in 1960 and 1962 respectively. 

He is currently an Associate Professor of In- 
dustrial Engineering at Kansas State University, 
His area of research interest Includes optimiza- 
tion techniques, systems engineering and fluid 
dynamics . 


189 



(efl 


ELEVENTH JOINT AUTOMATIC CONTROL CONFERENCE 


COOKMTMG SOCIETIES: 


4 


Auerican Institute «f Aeronautics and Astronautics 


OF THE AMERICAN AUTOMATIC 
CONTROL COUNCIL 


^ American Institute of Chemical Engineers 


The American Society ot Mechanical Engineers 



Fluid Fewer Society 


Georgia Institute of Technology 
Atlanta, Georgia 

June 22-26, 1970 



The Institute of Electrical and Electronics Engineers 



Instrument Society of America 



SiMlitiofl Centals, lie. 


Paper No. 19-A 

OPTIMAL STARTUP CONTROL OF A 
JACKETED TUBULAR REACTOR 

D.R. Hahn, L.T. Fan, and C.L. Hwang 

Institute for Systems Design and Optimization 

Kansas State University, Manhattan, Kansas 66S02 


Published on behalf of the American Automatic Control Council 

by 

THE AMERICAN SOCIETY OF MECHANICAL ENGINEERS 
United Engineering Center 345 Eas* ? Street, New York, N. Y. 10017 



*3 


SESSION PAPER 19-A 


OPTIMAL STARTUP CONTROL OF A JACKETED TUBULAR REACTOR* 
D. R. Hahn, L. T. Fan, and C. L. Hwang 
Institute for Systems Design and Optimization 
Kansas State University, Manhattan, Kansas 66502 



ABSTRACT 

The optimal startup policy of a jacketed tubular 
reactor, in which a first-order, reversible, exothermic 
reaction takes place, Is presented. A distributed 
maximum principle is presented for determining weak 
necessary conditions for optimality of a dlffuslonal 
distributed parameter system. A numerical technique is 
developed Cor practical implementation of the distrib- 
uted maximum principle. This involves the sequential 
solution of the state and adjoint equations, in con- 
junction with a functional gradient technique for 
iteratively improving the control function* 

INTRODUCTION 

This paper presents an optimal policy for startup 
of a jacketed tubular reactor in which a first-order, 
reversible, exothermic reaction is taking place. The 
optimal control policy is determined by using a dis- 
tributed maximum principle. The control or decision 
variable is the wall temperature of the reactor, which 
Is manipulated to minimize a given performance Index. 
Computational results are obtained for a case with and 
without a constraint on the maximum reaction temp- 
erature. 

The mathematical model for the jacketed tubular 
reactor is a continuous distributed parameter flow 
system, which gives rise to a set of coupled non- 
linear one -dimensional second-order parabolic partial 
differential equations. A distributed maximum prin- 
ciple used by the previous workers, for example Denn, 
et. al. [1], is extended to a general system of non- 
linear diffusion equations, with two-point boundary 
conditions consisting of linear relationships between 
v dependent variables and their axial gradients* A 
set of necessary conditions for optimality la obtained 
for a fairly general performance Index. 

In general, equations of the type treated cannot 
be solved by analytic methods and evan numerical tech- 
niques for coupled, highly nonlinear axial diffusion 
equations are not generally available. Therefore, an 
Iterative computational technique involving a gradient 
In functional space is presented, which enablee the 
numerical Implementation of the distributed maximal 
principle. It It shown that the technique Is capable 
of accomodating Inequality constraints on state vari- 
ables by the addition of an appropriate penalty func- 
tion to the performance index. 

A DISTRIBUTED MAXIMUM PRINCIPLE 

A distributed maximum principle le presented for 
determining weak necasaary conditions for optimality 


for a class of distributed systems. Due to the com- 
plexity of partial differential equations, a completely 
general maximum principle, as exists for lumped para- 
meter systems (2, 3) has not been found. However, suf- 
ficient generality has been retained that the results 
apply to a wide variety of systems of interest in pro- 
cess control. 

System Description 

Attention will be focused on systems whi^ h may be 
described by a general nonlinear vector partial dif- 
ferential equation of the form 

u t (x, t) - f (u(x, t), u x (x, t), u xx (x, t), 

0(x, t), x, t) (1) 

where u is an s-dimensional state vector defined on a 
normalized one-dimensional spatial domain x from x - 0 
to x - 1 and over a fixed time interval t - 0 to t • t- 
The control vector 0 is considered to be distributed in 
space and time and Is r-d iraensional . An independent 
variable appearing as a subscript denotes partial dif- 
ferentiation with respect to that variable. 

Equation (1) is augmented by the following set of 
initial and boundary conditions: 

C t (u) » 0 at t - 0, 1 • 1, ...» s (2) 

4 (u, u ) - 0 at x « 0, m - 1 (3) 

m - — x 

ip (u, u ) ■ 0 at x - 1, n • 1, . . . » q * 2s-p (4) 
n - -x 

It is assumed that no boundary forcing is present (i-«*» 
control action does not appear in the boundary con- 
ditions). 

Variational Equatlona 

Consider now small changes 60 in the control vec- 
tor fi. The resulting incremental responses 6u. in the 
state variables u must satisfy the following linear 
perturbation differential equations: 

«u - f T «u + f? iu x + f J + f J «e (5) 

* 2 " “x *- 

1*1, • • • I • 

where the above notation denotes the following: 
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The variational Initial and boundary conditions are 

^ fiu - 0 at t - 0, 1 - 1, ...» a (6) 

U 

fiu + $ T 6u ■ 0 at x ■ 0, b ■ 1 (7) 


T T 

\ fiu + i> 6u ■ 0 at x ■ 1, n 1 1| . ♦ . i 
n u n u x 

-* q “ (2. - p) (8) 

All partial derivatives are evaluated on the noolnal 
traj ectory. 

Equation (5) can be written in the form of a lin- 
earized vector partial differential equation 


<“ t - U, + Ui 4 Hx + ' » 4 -xx + £e M - 

- -X -XX 
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Necessary Conditions For Optimality 

It Is desired to determine the control function 0 
which yields a minimal for the following generalized 
objective functional: 


1 l 

- / F(u (x, t # ), x)dx + / I G(u (x f t), 

0 " * 0 0 


0 - r Q 

0(x, t) $ x , t) dx dt 


( 10 ) 


In order to obtain necessary conditions for op* 
tlaallty, it is required to find a relationship which 
expresses variations of the objective functional , 68, 
in tens of control perturbations, 60. Taking first 
variations on the objective functional, Equation (10), 
gives 


I » ^f if 

6$ - / r T 6 u dx ^ ♦ / / |c„ 6u ♦ 

0 . - t*tx 0 0 » • 


where 
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c # *«ej dx at 
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Consider now adjoining the variational system 
equation, Equation (9), as an equality constraint with 
the variational objective functional, Equation (11). 
This yields 


5S - f F fiu dx 

0 u - 


\ T T 

„ „ + / / {G fiu + G 60 

t “ t f oo u “ 


- z T [6u - f fiu -f fiu -f fiu -f fi0])dx dt 
- 1 -t -u - -u -x -u -xx -b - 
-x -xx 


( 12 ) 


(13) 


where z(x, t) la an s-d imensional adjoint vector. 

The following identity is now Introduced: 

T T T 

(z fiu) ^ fiu + z 6u fc 

Substitution of Equation (13) into Equation (12) yields 

1 t i **f 

F 1 fiu dxl + / 

t t 0 0 

(14) 


fiS 


/' F 1 4u dxl . + / fc T fiu + G 1 «9 

o u \ tmt f 0 0 u ' u 


-t(x T 4u)„ - 2 T 6<i - I T f 6u - 1 T f 
- - t -t — — “U — 

- * T f «u - 1 T L. «8]}dx dt 

- -u —XX “9 — 

-XX 


fiu 
-u -X 


A portion of the second Integrand of Equation (14) 
Is now Integrated with respect to x from x * 0 to x * 1 
by parts so that each term in the integrand involves 
either the variation fiu or 66. This gives 

u s Sx dx " l * u 


i T 

I . - / (z f ) 

— u ~-x *- =u • x»0 o “ x 

— X “X * 


It . T 

/ z T f fiu < dx - [z 
o - -u -xx 


f fiu 
-u -X 
-XX 


1 T 

> <! U, > 

0 -XX 


fiu dx 

(15) 

-<5 T *u >x 


-xx 


fiu dx 

(16) 


Another term in the second integral of Equation (14) is 
integrated with respect to t, yielding 


fc* T T ^f 

/ 1 (z T 6u) t dt • 1* 


(17) 


After some manipulation and noting that fiu(x, 0) m 0, 
the following result Is obtslned: 

« - / lT J - i ] dx |t-t f + / */ UC 8 T + 

yq + is t T ♦ s T u - <*- T v* + (jT 

+ c u T )«u)d» dt + /** i« T r - (« T t, ) X J«“ 

0 L =* -xx 

+ « T r «uj l dt < w > 

An .qulval.nt r.ault mi obtilaid by D.nn, it. W 
using • Gram', function approach. 

In ordar to alinlnata tarma not dapanding «pii«" 
ltly on 46 fron tha aacond in t .grand of Equation (W» 
it la atlpulatad that anch conponant of tha adjoint 
vactor a aatlafy tha following partial dlffarantlal 
aquations 

»i ‘-it* (£ T t >. - <i T t >« - V 

1 1 *z XX 

1 • 1, • a • , • (lM 
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The boundary condition* for Equation (19) are aped- 
fled auch that 


t [* f - (* f ) ] 6u + z f 6u -C 

- -u - -u x - - -u -x - 

-x -xx -xx x-0 


( 20 ) 

Thla la accomplished by choosing the adjoint boundary 
condltlona such that the coefficients of the unknown 
endpoint variation 6u and 6u x vanish. 

At thla point, the system boundary conditions. 
Equations (3) and (4), are assumed to be linear and 
have the more explicit form 

^(u, u^) - 0 • u 1 + a^ u + b jL at x - 0, 

1-1. .... • (21) 

^(u, u^)-0"u A + u i + <J i at x “ 
x 

1 - 1, .... s (22) 

The corresponding boundary variational equations 

become 



4u t - 

0 at 

x — 0, 1-1, . .., s 

(23) 

4u 1 +c i 

6u^ - 

0 at 

X - 1, 1 - 1, oao, S 

(24) 


The unknown endpoint variations 6 x 1 * In Equation 
(18) can now be written In terms of the respective 
unknown variations 6 u. To set the coefficients of the 
6ui equal to aero, the adjoint variables a* are 
required to satisfy tha following 2s conditions at 
x ■ 0 and 


■ t > -(.’t 


XX XX 


• 0 at x *0, 

1 - (25) 


X XX 


• • 

• 0 at x- 1, 


1-1, .... a (26) 

The specification of the adjoint vector la com- 
pleted by stipulating the t ran* vers all ty conditions 


•i’V 


at t * t^, 1*1, .... e 


(27) 


This causes the first Integral In Equation (8) to 
vanish and it follows that <8 can now be expressed 
explicitly in terns of the control perturbation, 66 1 

It - /** /* !«*♦«* fj*t dx de (28) 

o o ; ~ ~z ~ 

It la cnmiMt to doflna a Haalltoolan function 
><«. J B . •> a, i, t) 

• 0(u, I. x, t) T f(u, u x , « n i {, a. t) 

(») 


so Chat Equation (28) becomes 
6S 


*f 1 T 

/ / H 0 T 69 dx dt 

0 0®" 


where 


3H 

36. 


3K 

39- 


(30) 


It follows by reasoning similar to that of Katz 
(4) who achieved a similar result for a more general 
and abstract class of problems, that the best choice of 
control action 6 which minimizes the objective 
functional S Is that which makes 


1 

/ U dx 

0 


(31) 


stationary over the Interval 0 < t < with respect 
to components of 6 lying Interior to the admissible 
control region and a minimum for those lying on the 
boundary. For control components interior to the 
region, this means 

f 1 H dx - 0 (32) 

0 6 

Essentially thi 9 Is an Infinite dimensional, or 
functional equivalent of Pontryagln's maximum principle 
(2, 3) for finite dimensional (lumped) systems. 

Suamary 

The distributed maxlmvu principle derived herein 
may now be summarized as follows. Given a system of 
partial differential equations 

;; e (x, t) 

- f(u(x, t), u (x, t), u (x, e), e(x, e), *, t) 

-X xx (33) 

•ubj.ct to initial and boundary conditions 


C t (u)-0 

St 

t *0, 

1" 1, .00, s 




(34) 

♦ t (u. JJ^-O-Uj -.a t Uj+hj 

St 

x« 0, 

i-1, a..,S 

(33) 

?!<», u„) «• 0 • u t +e t Uj + dj 

St 

x- 1, 

1 — 1, a a a ,8 


06) 


It la daslrod to obtain tha control vector •(*, t) 
which ninlnixaa tha objective functional 

8 • / l F(u(x, t # ), x)dx 
0 * 

** 1 

♦ / / G(u(x, t). «(x. t), *. t)dx dt (37) 

0 0 

for fixsd 

Tbs solution to tbs optimisation p rob Ism lavolvss 
tbs simultaneous solution of IquatJ o (33) with s sot 
of adjoint partial differential aquations 

) ®’\ <3#> 
l * L xx 1 

1 — 1, .... o 


which satisfy tha boundary conditions 
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* ** XX f40 . 

i-1. .... a 

and Che transverse 11 ty conditions 

• F at t-t r , 1-1. .... a (41) 

1 u i 

Equivalently, the problem can be formulated In 
terms of a Hamiltonian function defined as follows: 

H - C + J T f (42) 

The state and adjoint equations arc equivalent, then, 
to the Hamiltonian canonical partial differential 
equations 


Vv 


1-1, .... a (43) 


»1 *< H U V< H U >*x' iml '“> 

x t u i u i M i 

The weak necessary conditions are that the 
spatial Integral of the Hamiltonian Is made stationary 
with respect to choices of components of 8 which lie 
interior to the admissible control region and a mini- 
mum with respect to components on the boundary. 

The results can readily be extended to systems 
which include boundary forcing and free Initial state 
(1). Extensions could also be made to accomodate 

C vultl-dimensional spatial coordinates and hlgher- 
jrder spatial derivatives 

Thu solution of th«i two-point boundary value 
system of partial differential equations coupled with 
the satisfaction of the necessary conditions presents 
a fornlulble coaputatlonal problem. However, an 
approximate numerical method Involving a gradient In 
function space Is Introduced in the next section to 
greatly facilitate the obtaining of numerical rcsulta. 

A COMPUTATIONAL APPROACH FOR DETERMINING OPTIMALITY 


It Is desirable to Insure that perturbations In 
the control vector, 68, ere small enough that lineari- 
sation leading to Equation (9) is valid. To 
accomplish this, a technique originated by Bryson and 
Denham (8) and extended to the infinite dimensional 
caaa by Salnftld (6) la utilised. Let 

2 *f 1 t 

(6P) - / / 68 W 68 dx dt (45) 

0 0 - - - 

be a positive definite quadratic form with W-W(x, t) 
a matrix of suitably chosen weighting functions and 
6P a scalar which is specified to limit the magnitude 
of the perturbations. 

Equation (45) is Introduced into Equation (30) 

In terms of an undetermined Lagrange multiplier X as 
follows: 

*f 1 t t 2 

6S - / / (H* -X66 4 W)58 dx dt+X(6Pr (46) 

o o 2 • • - 

In order to attain the maximum rate of change of S 
with respect to 8, the Integrand of Equation (46) Is 
maximised by differentiating with respect to 68 and 
equating the result to zero, this yields the 
following expression: 


Substitution of Equation (47) into Equation (45) gives 
2A-+ I / * Z 1 H. T W -1 H. dx dt / <«P) 2 ] 1/2 (48) 

~ o o 2 ■ 2 

Using the above expression In Equation (47), the 
variation, 68, can now ba written 


68 ■ ♦ ■' ■ — .jz (4 

*f 1 T —1 2 * ^ 

[ / / rt. T W 1 dx dt/(6P) j 

0 o 2 ~ 2 

where the minus sign la used for the case where the 
objective functional, S, la to be minimised. 

for the case where 8 • 8(t) only, the weighted 
metric. 6P. la defined as 


Developed in this section la a computational 
schema for obtaining numerical results from the dis- 
tributed maximum principle presented. The method la 
iterative In nature, involving repeated numerical In- 
tegration of the performance and adjoint aquations, 
combined with the use of a functional gradient 
technique to improve the control vector. 

A Functional Gradient Technique 

A relationship of the type of Equation (30) can 
ba thought of in earns of a gradient in function apace, 
la this caaa. Hj^ may ba taken to ba gradient $g in the 
function apace of 6. The maximal rata of dacraaaa of 
the functional 8 la the apace of J will ba in the 
direction Mg. This relationship provides the basis 
for a c omputational schema by which the objective 
functional S cam bo minimised with respect to choices 
of 0. 

m 

C Several popart hove appeared recently (1. 5. 4). 
lilch have extended flaltft dimeeeioaal tcchnlquoo to 
infinite dimensional ays tana in function space. The 
idee of o gradient in function space seems to hove 
boom originated by Course t and Hilbert (7). 


(6P) - / 68 W 68 dt (50) 

0 - - - 

Introducing Equation (50) into Equation (30) by naan a 
of the undetermined Lagrange multiplier. X. yields 

««- I * l I 1 a. 1 ** dx - A46 T W 4t)dt+ A(4P) 2 (51) 

0 0 5 " - - - 

Differentiating of the integrand of Equation (51) with 
respect to 66 and letting the result equal to sero so 
so to obtaln’tha maximum rata of change of 6S yields 

w" 1 J 1 <U 

«• - - 1 — (52) 

and substitution of the above expression Into Equation 
(50) gives 

Ef 1 m | 1 J 

2X-+1 / | / H. X dxJW *| . / H. dx]dt/(6P) / ) 

" fl A o • O e 


Thus upon substituting the above aquation into 
Equation (52). the variation, 66, becomes 

M t r 1 ■» * 

" ’ I 0 / tf 77 i f T dxjM" 1 !^ II dx)dt/(4P) 2 ) 1 ^ 2 

(54) 


The computet lonal scheme for obtaining the optimal 
control policy via the necessary conditions of the dis- 
tributed maximum principle and the functional gradient 
f technique can no/ be summarized as follows: 

1. An Initial control policy 6(x, t) ij aasisaed, 

2. Using the assisted policy in the system 
equations these are solved forward in time 
from t - 0 to t*tf and the transient 
solutions retained. 

3. The performance functional S Is evaluated 
using the values of the scat* variable# com- 
puted in 2. 

4. Using final values of the state variables to 
compute the final conditions on the adjoint 
variables and Inserting computed values of 
the state variables where required in the 
adjoint equations, these are solved backwards 
in time from t - t* to t - 0 and the transient 
solutions retained. 

5. An Improved control policy is calculated 
using the gradient technique with values of 
the adjoint variables computed In 4. 

6. Steps 2 through 5 are repeated Iteratively 
until the objective functlc il converges to 
within a specified tolerance. 


the reaction rate Is temperature-dependent, it vs 

that the yield can be controlled by varying the 
reaction temperature. In this example, the reaction 
temperature and thus yield are controlled by manip- 
ulation of the reactor wall temper iture. 

The mathematical model for the system la baaed 
upon the foliating essimptloas: 

1. System parameters are uniform and constant 
with respect to time. 

2. Wall temperature is a function of time only. 

3. Axial heat and mats dispersion and mixing 
are significant Inside the reactor. 

4. Concentration, temperature and velocity of 
the stream are constant with respect to 
radial distance. 


along the reactor yields for component 


!!a 

3t 


a 2 c. 


ar 


!!*♦, 

at *a 


(56) 


where, for the case of a first-order, reversible Aj B 
reaction, the 'ate of production of A, H A , la given 
by the Arrhenius expression 


A flow diagram for the method is jhown In 
Figure 1, 

Provision for State Variable Constraints 


*A"~ lk l C ' k 2 C B 1 
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The development of the necessary conditions for 
optimality and the accompanying functional gradient 
technique thus far have not taken Into account the 
presence of Inequality constraints Involving state 
variables. In cases where such constraints are Imposed 
i^on the system, it la required to modify the nee* 
earary conditions for an extremal solution ao that con- 
straint violations do not occur, or are at laaat 
reduced to an allowable tolerance. 

Consider the following general inequality con- 
straint 

c <!». •> < 0 (35) 

ulMn C may or nay not Involve tho control e * xp lic- 
it ly. ‘ 


A convenient method for handling such constraints 
is the penalty function approach. This involves the 
addition of an extra term or terms to the performance 
functional to incorporate the constraint. Thane terme 
heme aero value tmtll a constraint la violated md 
impeee e penalty when violet lone occur, iy iteratively 
decreasing the magnitude of the penalty, the 
trajectories may be forced to converge to the com- 
stralnt boundaries « This amounts to solving a sequence 
of unconstrained optimisation problems with penalised 
performance functionals, each time decreasing the 
amount of penalty until constraint convergence is 
attained. 


A heet balance on the differential section of 
the reactor yields 

* T C p _2 11 Co C or lT V K * n 

P 9t p p 

It la assimud that the manner of mixing la such 
that the affective mass and thermal dlf fuslvitlea are 
equal, l.e.. 

The bom da ry conditions for this problem ere 
those first suggested by Danckwerte (9) 


-Si — ’>-«!> 

»c A a, t) 

-Si — 0 

• ftT<0. t> -T*J at 1-0 


oe 


•t 1 • L 


(30) 

C3») 

(60) 


-0 at 1 - l (61) 

Tbnaa boundary condition, ar. baaed on tbo conoid. r- 
atloa that aaaa aad energy ara aalthar ccaatad aor 
daatroyad la tba laflaltaalaal r.gloa l - 0" to t-0*. 


OPTIMAL ITAHUP OONTML OP A JACUTBO 
TWULA* UACTOK CONSTRAINT OO 
MAXIMUM UACTION IDPIUTUM 

Tbo ccapwtatioaal ac h .ao dav.lopad la tbo ,rn- 
cadlat aactloa will bo affliad to control of a tubular, 
ceatlauoua (law ebaa leal reactor la wblcb an ex.tb.rnlc 
reaction la taking ,lac«. It la aaauaad that tba 
raactloa la fl/et-ordar aad rawaralbla (A * l), liana 


Xguatleaa (36) aad (37) ara gat la diaaaalaalaae 
fora by defining tba fallowing inanition i 


Mann rnsidaaaa tlaa 
Aaial Pec lot aatw 
Maaaaloalaaa tlaa 
M aaaa l ea l ana aaial dlataaea 


t t,»W» br 
1 6 -vL/B 
* t« t/r f 

i a-t/L 


( 71 ) 


Dlnanslonlass concentration of A : u^- c^/Cc^* c^) 

Dlnanslonlass reaction tenperature t - T/T f 

Dlnanslonlass wall temperature : • - T^/T^ 

Other parameters : 

AH(c ♦ r ) 

Q — c ; pl r ' » Km fy>r hr-1, W*V W”r 


Thus the system eqv tlons become 


• »* 2 


TT - V<V u 2> 


»Wj j»ttj JUj 

U 2 ) - KT r (u 2" ®> 

where 

♦ • k 10 # * p(-P l /u 2 )u l * k 20* xp<-P 2 /u 2 ) ’ V 

Th« boundary conditions srs 

»«,(0, t) 

#tuj(0, t)-u*J at x • 0 

t) 


>u,(0. t) f 

«lu 2 (0, t) -u£J 


bUjCl, t) 


Initially the concentration and tsapsraturc pro- 
fllaa ara asswed to bo constant throughout tha length 
of the reactor and at tha values of the Inlet coo- 
dl tlons, l.e., 

»,(*. 0) • »( at t • 0 ill) 


Wj(x, 0) • Uj 

■j(». 0) • u 2 


at t • 0 

at t • 0 


It la presupposed that a steady state operating 
point has bean determined which la optlaal with respect 
to aa«M performance criterion (e.g. t saxleu. yield). 

The startup policy. In turn, la to be determined such 
that by controlling tha addition or removal of hast, 
the process is driven from the initial atate toward 
tha final steady atate in some optimal fMhlon. Tt la 
desired to ninimlaa the spatial integral of tha 
weighted m of tha squared concentration and tem- 
perature deviations from the desired steady stats pro- 
files, uj (x) and ug (x), lntagrated over a transient 
startup period of filed length. The performance 
functional may thus be written 

• - / * / 1 |u|w 1 («, t> - e. <n)) 2 
0 0* *4 

♦ v(w,(x, t) - e, (a)) 2 ) dx dt (70) 

| d 

Pare u and v are suitably chos en constant weighting co- 


here wand v are suitably chos en constant weighting co- 
efficients. The manipulated variable is tbs dlnen- 
ilaelit; wall teaperature, I, which is considered to 
be s function of time only and lie within the rage 


6 . « 0(t) < 0 

min - w - mix 

The Hamiltonian, a* defined by Equation (42), is 

B-wtUjCx, t)- Ul (x)} 2 + v[u 2 (x, t)-Uj (x)l 2 

d d 

+, i I ‘f g i jut - u i > - V ( V u z )] 

♦ * 2 Ij«2 “ m 2 * Q V ( V u 2 ) * KT r (u 2" 8)1 (72) 

With reference to Equation (19), the idjoint 
pertlil differential equation* corresponding to 
Equation* (62) and (63) respectively ere 

V® V V T 'V V “2 >, i +Q Vu l (u r“2 ,, 2 

-2wlu.(x, t)-u. (x)J (73) 

4 4 d 

V® * 2 „" V v«<v 

t XX X 4 


x - 0 

(64) 

+ MVu^V U 2 )+ V«2 


• 

M 

(45) 

- 2v(u 2 (x, t) - u 2 (x)) 

where 

(74) 

O 

■ 

H 

(60 

i^“ k 10 M ‘ >( - P l /u 2 ) + k 20*“ p(_P 2 /u 2 ) 

(75) 

X - 1 
i assumed: 

(67) 

I p i k io ex P ( - p i /u 2 )u i 


*• ‘io-’- 

51 

” P 2 k 20 M?( " P 2 /u 2 )(1 ‘ “l 7 1 

(76) 

-3.03, 


Since the boundary condl given by Equations 

(64) through (67) correspond to the general forma. 


Equation* (21) end ill) , the adjoint boundary con- 
dition* correspond to Equation* (210 and (2b), 
respectively. Thus 


(0c t) • 6 


at x • 0, 1-1, 2 (77) 


(1. 0+6.1 (1, t)-0 at x- l, 1-1, 2 (78) 

% 

Tha final condition* on tha adjoint varlablt* 
correapondlng to Equation (27) ara 

* t (*» t f ) - 0 at t - t |# 1 - 1, 2 (79) 

Tha solution of Equation* ;62) and (63) forward 
in tin* from t-0 to t • tf la accompllahad by tha uam 
of quasi Unaarlxat Ion (10, 11) togethar wltn an 
implicit dlffaranca a ch an * . Tha datalls of tha com- 
putational mat bod ara praaantad in (12). 

To apply the quaail.'nearlaatlon technique, the 
uonllneer tana 4(ui, u 2 ) la aquation* (62) md (63) 
ara first llnaarlaad by maana of a first-order Taylor 
sarlaa exp and ad about tha (k-l)-th iterative solution 
gCk-1) m follows: 

tube tl tut lea of Bquatlem (tO) late Kqeatioae (42) asd 
(43) yisids tha fsUswiag Ilasarisad recurreec# 
rslstieashipt 


a I ■ 


i 




> t ' 
£ v? r 


-« - ± - y . <k -‘> ♦ .£-» <u‘ k > - «< k - l > ) 

(61) 
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“S" 1 - r -T - •?’ -«y ♦ <k ' 11 * •i 1 ’" <4“ - 

0 «* * i 1 


.(k-1), (k) (k-1), 


vf 


(82) 


(83) 


The solution of Equations (81) and (82) Is 
greatly simplified by "decoupling" the component 
equations* This Is done in the i-th equation by 
setting 

r )-i 

<k-D- 

J J L o j*i 

Then Equations (81) and (82) become 

«; k) - } «< k > . «; k) - t / l) * c l) <u< k > - «r>„ 

*t 6 X xx \ r U 1 1 1 

(64) 

u< k) -f «< k > -< k > + 


(k) 


KT r (u 2 


e) 


This Is valid, for as convergence Is attaiued, 
pproac *s uj fc ^ * 

|gp^ed as 


(85) 

(k-1) 


approac *s u}~'. The equations are still implicitly 
-1) contains the solutions and 


Equations (84) and (85) are most conveniently 
solved by finite difference methods* However, for 
parabolic equations care must be taken in applying 
explicit difference approximations that stability is 
ensured. In order to circumvent this stability 
problem, the Implicit scheme due to Crank and Nlcolson 
(13) Is considered here. This method introduces more 
complexity into the difference model but guarantees 
stability for any Increment of time, thus reducing the 
number of time Increments required. 

In applying the Crank-Nlcolson method the spatial 
axis Is discretized Into M increments of equal length 
Ax so that Ax ■ 1/M. Time discretization Is effectad 
by solving the difference equations at equal time in- 
crements At. The solution u(m,n) denotes the value of 
the dependent variable at the spatial location (m-l)Ax 
and at time (n-1) At. 

The partial ties derivatives are approximated by 
taking forward dlfferancas between the (n-l)-th and 
n-th time steps, i.a.. 


\ * yj lu(m, n> - «(»• n-l)l 


( 86 ) 


For spatial discretisation, Implicit dlffaranca 
operators are constructed for tha first and second 
spatial partial derivatives by taking cantral dif- 

O ferwncas, averaged over the (n-l)-th and n-th time 
attpa, l»e», 

m2 

u xx ^ T o) ♦u(m-l, n) 

♦ u(mfl, n-1) - 2u(», n-))+u(m-l, n-1) ] 


(87) 


u x ^ 5 l u (»^l. n) - u(m-l, n) 

♦ u(m+l, n-1) - u(m-l, n-1)] 


( 88 ) 


The above difference operators have a discretization 
error on the order of (Ax) 2. The dependent variable u 
is also averaged over the (n-l)-th and n-th time 
steps: 


u % - (u(m, n) + u(m, n-1)] 


(89) 


The difference approximations for the first deri- 
vative terms occurlng in the boundary conditions at 
x«0 and x*l are taken to be three-point forward and 
backward differences respectively: 

u I [-u(3, n) + 4u(2, n) - 3u(l, o)) (90) 

x x-0 


| (3u(h+l, n) - 4u(M, n)+u(M-l, n) ] (91) 


destitution of the above difference operators into 
the recurrence relations. Equations (84) and (85), and 
the boundary conditions, give rise to the set of 
linearized difference equations for the k-th iteration 


r. (k-D,, fL x . 4M 
[B 1 (2 ‘ n) + 2S + 3M V“1 


A,)u, (k) (2, a) 


+ [C 


A.)u. <k) (3, n) 


1 26 3M 1* 1 
AjUjU, n-1) - D 1 <k ~ 1) 


(2, n) Ul (2, n-1) 


26uJ 


- CjU^O, n-1) - ^(2» n) “26+3H A 1 

AjUj^' («-l, n) + B^ -1 * (», n)Uj* k3 («, n) 

+ C lUl <k> (»fl, n) 

- -A 1 u 1 (*-1, n-1) - (a, n) u^(a, n-1) 

- C^afl, n-1) -E 1 <k ' 1) (a, n) 


(92) 
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,A 1 - I c i iu i <k>(M ‘ l » n) 


+ (B 


(k-1). 


00 , 


A (M, n)+-j CJu^'Of, n) 
(k-1). 


AjUjOI- 1, n-D-iy '(M, n)u 1 (M, n-1) 

J 


- CjUjORl, n-1) - E 1 (k_1) <M, n) 


(B 


(k-1). 


4N 


00 , 


2 A 2^ u 2 

+ ^ C 2 “ 26*+ 3M ■> 

(k-1) , 


--Ajttjd, n-l) - Oj' *'(2, n)u 2 (2, n-1) 
-CjttjO, n-l)-B 2 (k ' l) (2, n)-^--!-.^ 

A 2 u 2 (k> («-1, n)+B 2 ^ k * l) (n, n) u 2 <k) (n, n) 


(93) 


♦ C 2 tt 2 <k) («fl, nj 
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--AjU 2 (»-1, n-1) - D 2 ^ k '^(», n)u 2 (a, n-1) 


-CjUj ( n+1, n) 


i"3, ...» M-l 


lA 2" 3 C 2 J “2 <k>(M_1 * n> 


♦ lB 2 (k_1) (M, n) + | C 2 ]u 2 (k) (M, n) 


(k-1 ) j 


• -AjUjtM-l, n-1) - D 2 ' *'(M, n)u 2 (M, n-1) 


•C 2 u 2 (Nfl, n-1) -E 2 (k_1) (M, n) 


where 


, . M 2 . M 

Wtt+4 


■ (k-1) /_ (k-1), m!.J_ 

*1 ( *» n> 2 Vu, n) B At 


(k-1). 


I Qt » Ck-D, 

2 M r u« 


2 r 6 At 


_ M 

C l" C 2* 28 ~~i 


D.^Cn. n).- | Vu '—(«. 


(k-1), 


M 2 . 1 


0) "T K, r "T*« 




- . «-»(., .) „>1 
1 “l 


(k-1) 


(k-1), 


(a* n)-- Qt r U v '(a, n) 


- u 2 (k-1) (^ n)» u (k_1) (a, n)) + Kt r 9 


The endpoint values ere determined from the following 
boundary equations 


“i**^ 1 * *>•* “j <k) o. *>) 




(94) 


j 


20 + 3M 1 ' f ' 204* 3M 1 

u 2 (k) (Mfl, n) « ± Ul (k) (M, n)- i Ul (k) (M-l, n) (95) 

* 5TTK »> ♦HT5 <»> 

u 2 (k) (Hfl, n)-± Uj^W, o)-| Uj <k> (M-l, n) (97) 


Similarly the backwards solution of equations 
(73) and (74) from t - tf to t*0 is accomplished by 
solving the following sets of implicit difference 
equations from n «N to n - It 


0 l>j(2, n )+3 n) 

♦ lCj -3 Ajl* 2 <k> (3, n) 


--Ajtjd, n+1) - Dj(2, n+1) tl (2, n+1) 


-CjijO, n+l)+E 3 (k_1) (2, n) 


A 3 *j^(«- 1, n) + B 3 (n, n) 


+ C 3 * 2 ^ (■*•!, n) 
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1 1 
1 (■, n) j 

m m 3» . . . » M~1 j 


(96) 
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-C 4 z 2 (a+1, n+1) + E 4 (k_1) (a, n) 
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The endpoint values for the adjoint variables are 
determined, using the following boundary equations: 

* 2 <k> (1» «)-- ^ «i (W (5. ") + 3 * x <k> (2, n) (100) 

«)-20T3m *i (k)(M * n) 

“TiF+15 *i^ k)(M-1 » n) doi) 


Equation (79). Thus for convenience, the initial con- 
trol trajectory approximation was taken to be 
0(t) ■ .6 dimensionless temperature unit, the steady 
state value. 

Figure 2 shows the optimal control trajectory 
obtained after 30 iterations, using a perturbation co- 
efficient of a ■ .1, This value, determined by trial 
and error, provided a reasonable rate of convergence 
of the performance index to a minimum without 
oscillations. The policy is seen to approach a bang- 
bang trajectory with maximum wall temperature applied 
to the system initially. At about .20 residence time 
a switch to minimum wall temperature occurs, followed 
by a singular approach to the steady state value 
starting at about .44 residence time. 

The resulting transient concentration and tem- 
perature profiles, u^Cx, t) and U 2 (x, t) , obtained 
using the optimal startup policy are shown in Figures 
3 and 4, respectively with time is a parameter. Shown 
in dashed lines for comparison are the transient pro- 
files resulting from using steady state control. The 
value of the performance Index obtained for the 
optimally controlled case was .04655 7 compared to 
.050435 with steady state control. 


* 2 (k) <l, n) - - ^ r 2 °°(3, n) +-| * 2 (k> (2, n) (102) 

, 00 fm ., „ *M (k). . 

z 2 20+3M Z 2 

-2675 l 2 <k)(M ' 1 - n) < 103) 


Upon obtaining the adjoint solutions, an improved 
control function 6(t) may be obtained using Equation 
(54) and the Hamiltonian defined in Equation (72). 

The resulting change In control, 60(t), is 


60(t) 


0 / KT r * 2 (x, t)dx 


( Q / * (g/ 1 Kt r * 2 (x, t)dx] 2 dt) 


172 


(104) 


where o can be considered as a perturbation coefficient 
representing step length. Using Simpson's Integration 
scheme, values of n )* Mfl, n • 1, 

..., N+l, obtained by backwards solution of the adjoint 
equations, may be used in Equation (92) to compute 
66(n), n - 1, . .., N. The new control function 8(n), 
n-1, . N is then found from the relation 

® <n> |n«v ’ 9(n) |old + <9<n) <M5) 


Computation was performed using a time increment 
of .02 residence time and a spatial increment of .05 
dimensionless distance unit. The limits on tha con- 
trol wars assumed to be 0 aax -,670 and *530 

dimensionless tamparature unit. Tha performanca index 
S was evaluated using a terminal time of one residence 
time and the weighting coefficients u and v ware each 
taken to be unity. The dealred steady state profiles v 
ui .(x) end U 9 d (x), were chosen to correspond to e con- 
trol value of 9 ■ .6 dimensionless temperature unit. 

With regard to tha selection of the Initial 
approximation. It should be noted that the steady 
state value of the control must be known end used in 
the Initial assumed trajectory at the terminal time 
t*. This is because the algorithm is Incapable of 
shitting tha control at terminal time, as sear from 
Equation (104) and tha t r ana vers all ty conditions. 


Since the optimal control policy so closely 
resembled bang-bang control, a purely bang-bang policy 
was considered. This consisted of starting with maxi- 
mum effort, switching to minimum effort and finally 
switching to the steady state control level. These 
two switch points were approximated from the optimal 
trajectory to be .20 and .50 residence times 
respectively. The state equations were solved using 
the bang-bang policy and the performance index. 
Equation (70), was computed, yielding a value of 
.046555. Thus rhe performance index remained 
essentially unchanged using the bang -bang approximation 
and, because of its simplicity to implement, a bang- 
bang policy would probably be preferred for this 
application. 

Constraint on Maxlmm Reaction Temperature 

Suppose it is desired to determine the optimal 
startup control trajectory which minimizes the 
performance criterion. Equation (70), while at tha 
same time holding the maximum reaction temperature at 
or below a specified upper limit. This inequality 
constraint can be written 

u.(x, t) - u* <. 0 (106) 

max 

The conttrairt is Introduced into the performanca 
index as a penalty by means of a weighting coefficient 
o as follows: 

1 2 
s- / / (u[u.(x, t)-u. (x)r 

0 o 1 

+ v(u.(x, t) - tt. (*)) 2 

*d 

+ o(u 2 (x, t)-« 2 ) 2 h(u.,(x, t) -u, ])dx dt 

“* ‘ “* (107) 

where h(u 2 (x, t)-u 2Bax J la tha Heavy side unit step 
function. Thus a penalty la not Invoked until a con- 
straint la violated. The weighting coefficient o la 
Incraaaad iteratively, stopping tha Iteration whan tha 
maxim* tamparature has converged to within a specified 
tolerance of tha constraint boundary* 
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State variable constraints such as this require 
a corresponding nodi flea Mon of the adjoint equations 
since an additional term involving a state variable la 
► Introduced into the performance index* Thus the 
adjolot equations , Equations (73) and (74), become 


v*\ 


♦T (u., ujt 




2'‘1 


+ Q T r * u * u l # u 2^*2 “2u[u^(x* t)-u A (x) ) (108) 

1 d 


Optimization of the two-point boundary vaJue 
system of second order, non-linear, parabolic partial 
differential equations presents a formidable com- 
putational problem. An approximate numerical method 
which is iterative In nature, involving repeated 
numerical integration of the performance and adjoint 
equations, combined with the use of a functional 
gradient technique to improve the control vector Is 
Introduced to overcome computational difficulties. 

A convenient method for handling inequality con- 
straints involving state variables Is also presented. 


"a V 


V*1 


* W* r * u (°1» u 2* +KT r**2 " 2v l u 2 (x * O-Uj 00] 
2 d 

- 2o[u 2 (x, t)-u 2 ] h[u 2 (x, t) -u 2 ] (109) 

MX riXX 

Figure 5 shows the optimal control policy for the 
case of an upper constraint on maximum reaction tem- 
perature, uj x * .700 dimensionless temperature unit. 
The switch point from maximum to mlnlmun wall tem- 
perature occurs earlier than for the case of an uncon- 
strained state, thus reducing the amount of temperature 
overshoot. The following table lists the penalty 
weights o and the corresponding maxlmin temperatures 
that resulted after each ascent: 

Maximum 

o reaction 

— temperature 


(Unconstrained) 

1 

10 

102 

103 

10* 


.7165 

.7167 

.7093 

.7048 

.7014 

.7005 


The iteration was stopped for a - 10* as the 
resulting maximm temperature was considered in close 
enough proximity to the constraint boundary. Each 
time the value of o was Increased, It was found 
necessary to adjust the perturbation coefficient cx 
downward In order to prevent oscillations and In- 
stability of the performance index. 

Exit temperature trajectories for optimal control, 
with and without a state variable constraint, and for 
steady state control, are shown in Figure 6. 

CONCLUSIONS 

An optimal startup policy of a jacketed tubular 
reactor In which a first-order, reversible, exothermic 
reaction takas place la dftermlned. A distributed 
maximum principle la presented for determining weak 
necessary conditions for optimality of dlffuslonal 
distributed parameter systems. 
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11. 1 CONTROL OF A CLASH OF NONLINEAR DISTRIBUTED PARAMETER SYSTEMS 
VIA DIRECT SEARCH ON THE PERFORMANCE INDEX* 


D. R. Hahn, Project Engineer 
i he Bend lx Corporation, Kansas City, Missouri 

L. T. Fan, Professor and Head >f Chemical Engineering 
Director of Institute for Systems Design and Optimization 

C. L. Hwang, Associate Professor of Industrial Engineering 
Kansas State University, Manhattan, Kansas 66502, U.S.A. 


AB STRACT 

The synthesis of optimal controls is treated 
for a relatively wide class of mixed, continuous 
flow processes. This class is comprised of 
systems, the dynamics of which can be described 
by nonlinear, one-dimensional axial diffusion 
models with two-point boundary values. An over- 
all direct search technique is considered which 
is applicable to nonlinear distributed systems 
with control saturation constraints. This 
method, iterative in nature, entails a scanning 
of an overall performance lodex for different 
trial control levels at increments of time, 
yielding a piecewise-cons tan t control policy. 
State variable inequality constraints are 
handled by the penalty function method. The 
technique is applied to Me tabular reactor 
startup problem and the lesulting control policy 
is shown to closely approximate that obtained 
using a distributed maximum principle. A sub- 
optimal non-iterative direct search technique is 
also developed. This involves the evaluation of 
an instantaneous performance measure at the end 
of each time step for trial control values over 
the admissible range. This technique, applied 
to the tubular reactor startup problem, is shown 
to yield results similar to those of the other 
two approaches, namely, the distributed maximum 
principle and the overall direct search tech- 
nique. 


INTRODUCTION 

In the field of industrial process control, in- 
creasing attention is being focused upon the 
study of systems from the distributed parameter 
point of view. 

Perhaps the first work devoted to optimisation 
of distributed parameter systems was undertaken 


by Bulkovskii and Lerner.^* These papers 

considered mainly a class of first-order partial 
differential equations, which through a coordi- 
nate transform .tion, could be treated with 
Pontryagin's maximum principle.^, 4) a 
thorough review of the literature on the optimi- 
zation of distributed parameter systems is given 
in(^). Most of the literature has dealt with 
linear distributed parameter systems. Relatively 
few papers have appeared thus far which report 
successful computational results for nonlinear 
distributed systems. However, with the advent 
of larger and more rapid computing systems 
coupled with more sophisticated numerical 
analysis techniques, strides are now being made 
in this area. (6* 7, 8, 9) Most of the workers 
in this field have employed variational tech- 
niques and have obtained various forms of maxi- 
mum principles. 

As an alternate method involving less com- 
putational complexity than the maximum principle, 
an overall direct search technique will be pre- 
sented in this work. This approach is applicable 
to systems with saturation constraints on the 
control variable and entails a scanning of the 
performance index at increments of time for dif- 
ferent trial control levels. The method is 
iterative and considers an assessment of per- 
formance based upon the entire period of 
operation, A simplified non-itcratlve direct 
search technique will also be considered in this 
work. This method involves the evaluation of an 
instantaneous performance measure at each time 
step for different control levels and thus yields 
a suboptimal policy. Provision for state vari- 
able inequality constraints wi*l be considered 
for both direct search techniques. 

The implementation of the direct search tech- 
niques is accomplished by utilizing quasi- 


*This study was supported in part by NASA Crant No. NGR- 17-00 1-034, and by the Air Force Office of 
Scientific Research, Office of Aerospace Research, United States Air Force, Under Contract 
F44620-6 8-0020 (Themis Project). 
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linearization, decoupling of the equations and 
the application of an implicit difference tech- 
nique for obtaining the transient solutions to 
the system of nonlinear partial differential 
equat i ons . 

Optimal control of n startup of a jacketed tub- 
ular reactor in which a first-order, reversible, 
exothermic reaction is assumed to take place is 
considered. It is determined how the wall 
temperature should best be manipulated to mini- 
mize a given performance index. Computational 
results are obtained for cases with and without 
a constraint on maximum reaction temperature. 

S YSTEM DESCRIP TION 

Suppose that a system is described by a general 
nonlinear vector partial differential equation 

u t (x,t) = f[u(x,t), u x (x,t), 0( t) 1 

( 1 ) 

where u is an s-dimensional state vector defined 
on a normalized one-dimensional spatial domain 
x from x=0 to x=l and over a fixed time interval 
t=Q to t=tf. The control variable © is con- 
sidered to be distributed in time only and is 
one-dimensional, with maximum and minimum limits 
specified. An independent variable appearing as 
a subscript denotes partial differentiation with 
respect to that variable. 


Initial and boundary conditions are 


f.jtu) « 0 

at 

o 

u 

4-1 

i - 

1 > ...,s (2) 

♦■ ( S'2x ) m0 

at 

X * 0, 

m * 

It .... P (3) 

* — x> * 0 

at 

x * 1, 

n * 

1, q»2s-p (4) 


It is assumed that no boundary forcing is 
present . 


It is desired to determine the control function 
0 which yields a minimum for the following 
generalized objective functional: 



F(u(x,t f )]dx 

0 o Glu(x,t), 0(t)]dx dt 


(5) 


OVERALL DIRECT SEARCH 


The method of optimization based on the distri- 
buted maximum principle^ <3 computationally 
complex and time consuming. The method to be 
discussed here stems from a similar direct 
search technique described by Lapldus and 
LuusOO) for nonlinear lumped parameter systems 
with saturation constraints on the control vari- 
ables, A modified version has been employed by 
Seinfeld and Lapldus(&) to treat systems with 


distributed parameters, although somewhat dif- 
ferent from the approach taken here. 

Description of the Method 

A number of control levels bj, j * 1 , ..., J art- 
selected, which are equally spaced over the 
range of admissibility and include the upper and 
lower limits. The time axis is discretizing 
from t *0 to t » tf into N segments of length 
tf/N and assuming a piece-wise-constant initial 
control policy 0v°)(n), n = 1, , N. 

Holding each 0(°)(n), n = 2, . . . , N fixed, the 
system state equations are solved from t - 0 to 
t*t f , replacing D(0)(1), in turn, by each 6 j . 
After each solution of the state equations, the 
overall performance index S is computed. If 
either extreme control level, i.e., ©i or Gj, 
minimizes S, that level replaces the original 
G(0)(1). If the performance index is minimized 
for a control level interior to the range of 
admissibility, interpolation is performed by 
fitting a three-point Lagrangian polynomial 
through the minimum point and each point 
immediately adjacent. The minimum value of the 
polynomial is then computed and the corresponding 
control level is taken to replace tf(^(l). 

The procedure is repeated for each time incre- 
ment n * 2, N. whereupon each original 

adeemed control has been improved. This ends 
the first overall iteration. Since at e*ch time 
step, the assumed control level would be retained 
if no improvement could be realized with another 
level, the performance Index must decrease 
monotortically . 

The improved control policy then becomes 0^)(n), 
n » 1, . N and is used as the starting point 
for the second overall iteration. This iter- 
ative sequence is repeated until negligible 
further improvement is realized in the per- 
formance index. 

A computer flow diagram for the ovrrall direct 
search scheme is shown in Figure 1. 

Provision for State Variable Constraints . The 
overall direct search method is very easily 
extended to account for inequality constnlnrs 
on state variables. These constraints may 
appear in the form 

C(u,e)<0 (6) 

As in the maximum principle approach^), a con- 
venient means for handling constraints of this 
type is the penalty function method. This con- 
sists of adding additional terms to the inte- 
grand of the performance index which have zero 
value until a constraint Is violated and 
imposing a penalty after a violation occurs. 

Thus the state trajectories can be forced to the 
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constraint boundary by iteratively manipulating 
the amount of penalty to be imposed. 

SIMPLIFIED DIRECT SEARCH 

Hnth the maximum principle approach^) and the 
overall direct search technique are relatively 
time consuming* This limits the usefulness of 
these procedures to off-line use in pre- 
calculating the open-loop system control policy 
and the resulting trajectory over the transient 
period of interest. 

However, the response of a real process may dif- 
fer significantly from that anticipated by the 
model because of model inaccuracies, changing 
parameters, load disturbances, etc., and it may 
become desirable to redetermine the control 
action periodically, using current inform. 1 ;ion 
about the state of the system. It thus becomes 
essential to have a simpler optimization scheme 
which takes into account the current state and 
uses this information to compute on-line an 
appropriate updated control policy, perhaps in 
conjunction with an adaptive scheme in which the 
model itself is also updated. 

An optimizing scheme called an "optimum 
predictor-controller" has been developed by 
Crethlein and Lapidus(H) for lumped nonlinear 
systems with bounded controls. The approach 
taken was to sample the state at discrete values 
of time, and using this data as the initial con- 
ditions, to calculate over one sampling period, 
the response for several levels of control with- 
in the allowable range. The optimal control was 
determined by evaluating the performance cri- 
terion for each control level and selecting that 
level which yielded the least value of the cri- 
terion. 

A similar approach is taken in this work for the 
determination of the control policy for a dis- 
tributed system whose dynamic behavior may be 
described by a system of nonlinear partial dif- 
ferential equations in which there is only one 
control variable, a function of time only. 

The feasibility of the method for on-line com- 
puter control would be contingent upon the 
sampling, computation and actuation times being 
short in comparison to the dynamics of the pro- 
cess under control. However, many distributed 
processes are characterized by long time con- 
stants and exhibit sluggish behavior, possible 
making on-line computer control attractive. 

Description of the Method . The proposed simpli- 
fied direct search method, instead of assessing 
system performance over the whole period of 
operation, evaluates the effect of control 
action over a relatively small Interval of time. 
Thus the technique must be considered suboptlmal 
with respect to an overall performance index of 
the type of Equation (5). A measure of per- 


formance may take Into consideration a time in- 
tegral criteiion i. >lving the response of the 
state variables over tin* small interval, cr 
simply an l ns tantaneous measure involving the 
state profiles at the end of the interval. The 
latter approach is considered herein. lhus a 
performance index could be considered in the 
sense of the integrand of the time integral of 
Equation (5) evaluated at a discrete point i*. 
time . 

Using the instantaneous state profiles as the 
initial conditions at each time t * (n-l)At, 
n * 1, ..., N, a numerical integration scheme 
is employed to predict the system response at 
t ■ nAt for a number of pre-selected control 
levels, each held constant for the duration of 
the time period. These control levels are 
equally spaced over the admissible region and 
Include the upper and lower limits. 

The performance index is evaluated at t = nAt 
for each value of the control and a direct search 
made to find the minimum value of the index. The 
determination of the optimal control level for 
the period is the same as described for the 
overall direct search. If the index is minimized 
for the upper or lower limit, that level is taken 
to be the optimal control level for the time 
period; otherwise an interior value is determined 
by interpolation. A computer flow diagram for 
this simplified procedure Is shown in Figure 2. 

P rovision for State Var iable C on stralnts . Th c 
simplified direct search technique can be 
extended to piovid*? for state variable inequality 
constraints of the form of Equation (6). However, 
instead of a penalty function approach, a direct 
method will be considered. 

Upon computing the ordinal control 0(n) for the 
time period t - (n-ljAt to t -nAt and the cor- 
responding state trajectories, a test is per- 
formed to detect violations of the Inequality of 
Equation (6). If a violation appears eminent, 
another control level is selected which tends to 
force the state trajectory away from the con- 
straint boundary. 

The ability to prevent constraint violations 
depends on the capacity of the control system to 
avoid the constraint boundary once it is 
approached. It may be necessary to consider two 
time intervals; (l) the period over which the 
responses are computed, say, (At)i, and (2) the 
interval over which the resulting control action 
is actually carried out, say, (At>2, where 
(At)i>(At> 2 . This would give the control system 
more advance warning of an Impending constraint 
violation and thus prevent overshoot (or under- 
shoot) of the constraint. This feature will be 
seen in the simplified direct search example. 
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OPTIMAL STARTUP CONTROL OF A JACKETED TUBULAR 
REACTOR 

The Mathematical Model , Consider a tubular, 
continuous flow chemical reactor in whim an 
exothermic reaction is taking place. The 
reaction considered is first-order and reversible 
(A 4 B) . In this example, the reaction tem- 
perature and thus yield are controlled by mani- 
pulation of the reactor wall temperature. 

The mathematical model for the system is based 
on the assumptions that system parameters are 
uniform and constant with respect to time, wall 
temperature is a function of time only, axial 
heat and mass dispersion and mixing are signifi- 
cant inside the reactor, and concentration, tem- 
perature and velocity of the stream are constant 
with respect to radial distance. 


axial Peclet number, t-i/i , dimensionless time, 
x-£/L, dimensionless axial distance, uj = c A / 

(ca + c b)* dimensionless concentration of A, 
U 2 S T/T r , dimensionless reaction temperature , and 
G*T W /T r , dimensionless wall temperature, other 
parameters are Q ® AH(r ♦ eg) / C p pT r , K * 2h/Cp t r 
hr"*, Pj*Ei/RT r , and . / 2 fc E2^ K ^r* The dimension- 
less boundary conditions are 

(0, t) - elu^O.t) - ujl 

x 


e c x=0 


u x <l,t) -0 

x 

u 2 (0, t) * 6 (u (0 , t) - u f ) 

x 

u 2 (l,t)-0 

X 


at 


at 


x* 1 
x*0 


at x*l 


(16) 

(17) 

(18) 
(19) 


A differential mass balance yields 
3c 


a = d 

3t m 


3 2 c 


The concentration and temperature profiles are 
assumed to be initially constant throughout the 
length of the reactor and at the values of the 




3c a 

- V ir +R a 

(7) 

inlet conditions, 
u 1 (x,0) - u* 

i.e., 
at t-0, 

(20) 

case of a fir9t-order, 

reversible 

u (x,0) - J 

at t*0 

(21) 


A i B reaction, the rate of production of A, R^, 
is given by the Arrhenius expression 

R A "“l k io t*xp(-Ej/RT)c A - k 2 o exp(-E 2 /RT)c B ] 

A differential heat balance yields 
3T . (-AH) „ 2h 


3T k efr 3 2 T ... . 

St "c P u , 2 ~ V 34 Co A c «P r 

p at p p 


(T-T w ) (8) 


It is assumed that the manner of mixing is such 
that the effective mass and thermal dif fusivities 
are equal, i.e., * k e f f /Cpp * D. The boundary 

conditions are(12) 


It is presupposed that a steady-state operating 
point denoted by the subscript d has been 
determined which is optimal with respect to some 
performance criterion (e.g., maximum yield) . The 
startup policy, in turn, is to be determined such 
that, by controlling the addition or removal of 
heat, the process is driven from the initial 
state toward the final steady state in some 
optimal fashion. In this example, the objective 
function to minimize is 

*f i ~ 

S • / / Mu. (x,t) -u_ (x)] 2 

on 1 lj 


*c a (0,t) 

5Y 

ac A (L,t) 

TT 


* 


iT a' l) tT(0.»> -T f ) at i-0 


“ ft * 1 -* 


equations (7) and (8) become 
1 

“ * J 1 * “2 


at 

1-0 

(9) 

at 

i«L 

(10) 

at 

1*0 

(ID 

at 

i-L 

(12) 

item 

equations, 


*) 


03) 

'2 )_ 

KT r (u 2 -8) 

(14) 


♦ ( u r u 2 ) 


* k 10 cxp< " P l /u 2 )u l” k 20 ex P<’ P 2 /u 2 )(1_u l ) 
whvrc t r >L/v hr la scan realdance time, 8» vL/D, 


+ v[u,(x,t)- u. (x) ) }dx dt 
1 l 4 


( 22 ) 


where u and v are suitably chosen constant 
weighting coefficients. The manipulated variable 
is the dimen 4 - ionlesa wall temperature, u, which 
is considered to be a function of time onl? and 
lie within the range 

* mln 1 <KO i e Mx (23) 

The following numerical values are assumed: 


0*5, 


• .05 hr, 


Q ■ -200, K « 30 hr 


-1 


k 1Q - 2.51 x 10* hr" 1 , k 2Q 


1 


1.995 x 10' hr 

? x • 5.03, P 2 - 10.06, T r - 1000*R, u'».9, 

f 


u 2 • .6. 

The kinetic data for the reaction are due to 

The transient solution of Equations (13) and (14) 
forward in time from t-0 to t»tf is 
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i i Tnr . ml* 




ny; K , e nr ^.”- " T ' 


.lc ir; » * m- *d by the use of quas l 1 incar i zat lon^^ 
ji.-i’tiK with an implicit lifforoncc scheme. 

Ili»' details rl the compu tat ional method are pre- 
* rut* d in ref . 3. 

Mpti'.il (nntrol Ls ln£ Over. 1 1 1 Hi let l Search. The 
true .i < i s wa> discretized into fifty increments 
of .02 resih-nee time and the spatial increment 
vis .03 dim* sionless distance unit. The time 
increment o V ei which a control level would be 
held constant was also taken to be .02 residence 
time. Initially, the assu. ed control policy was 
tnnsidered constant with respect to time and at 
the value corresponding tr that required to 
maintain the desired steady stau profiles; i.e., 

- (0) fn) = . 600, n * 1, . . . , 50 . r '\.iputat ion was 
performed for five levels o f control equally 
spa. cd over the admissible range, i.e., .530, 
.5*.;, .600, .635 and .670 dimensionless tem- 
po r iture units. 

Figure 3 shows the resulting optimal control 
policy obtained after three overall iterations. 
Actually, after only two iterations, negligible 
improvement of the performance index was 
obtained. Also indicated on Figure 3 is the 
resulting optimal control policy obtained by the 
dis i !*• hated maximum pr inciple . ( ^) Comparison of 
these results shows marked similarity of the con- 
trol policy to that obtained using the distrib- 
uted maximum principle. The resulting value of 
the performance index was .046555, almost iden- 
tical to the maximum principle result. 

Con straint on Maximum Reaction Temperature . To 
demonstrate the technique for dealing with state 
variable inequality constraints, an upper con- 
straint of U2 max ■ .700 was placed on the 
dimensionless reaction temperature . The penalty 
weighting coefficient was taken to beo-10\ 
which, as In the case of the distributed maximum 
principle was adequate to force convergence of 
the temperature trajectory to the constraint 
boundary* 

The resulting control policy for the temperature- 
constrained case is shown in Figure 4. Again, 
comparison of this result with the result 
obtained by the distributed maximum principle^) 
shows much similarity. For the constrained case, 
the overall direct search method was found to be 
quite sensitive to the initial assumed control 
policy. However, the initial assumption of a 
bang-bang policy approximating the maximum prin- 
ciple result yielded rapid convergence* 

Subopt imal Startup Control Using Simplified 
Direct Search * The total time period t *0 to 
t • tf is divided Into N equal intervals of 
length At. Instead of evaluating the performance 
over the entire time period, the performance Is 
appraised at the end of each interval, the con- 
trol being held constant over the interval* The 
performance Index for the n-th time Increment, 
n • 1, . .., N, is taken to be the integrand of the 


time integral of Equation (22) evaluated at time 
t " nAt. 

S n*</ - l, i d <*>) 2 

4 v[iyA,l |iM ) - U 2 (X) ] 2 }<lx (>'.) 

d 

Again fifty time increments of At* .02 residence 
time were used. The distance increment was .05 
dimensionless length unit. The performance 
index, Equation (24), was computed at the end of 
each time interval 3gain for five control levels. 

The resulting control policy is shown in Figure 

5. Comparison with the results of the maximum 
principle and the overall direct search, illu- 
strates great similarity. Although the per- 
formance was assessed over only one time inter- 
val at a time, without regard for the entire 
period of operation, the resulting transient 
concentration and temperature profiles were u.;ed 
to compute the overall performance index. 

Equation (22). The resulting value was .046555, 
essentially the same as those values obtained 
using the two previous approaches. 

Constraint on Maximum ^.action Temperature . 

Again an upper constraint of U 2 - .700 was 
placed on the dimensionless reac?¥on temperature. 
After computing each optimal control value and 
the corresponding state trajectories, a test was 
made For constraint violations. When the test 
was made at the end of one time increment, cor- 
responding to the intended time of application 
of the computed value, the control system had 
inadequate capacity to prevent overshoot of the 
constraint, even upon switching to the minimum 
level. A maximum dimensionless reaction tem- 
perature of .7096 was obtained, compared to 
.7175 without the constraint. Extending the 
check over two time increments, and switching to 
minimum control upon the detection of a vio- 
lation, a maximum reaction temperature of .7007 
resulted, which was considered within reasonable 
tolerance of the constraint boundary. The 
resulting control trajectory Is shown In Figure 

6. For more severe constraints, a check for 
violations might be required for several time 
Intervals in advance, or perhaps a value lower 
than the actual constraint could be used in the 
test. 

C ONCLUSION 

Two direct search techniques, each Involving the 
scanning of a performance index for different 
trial control levels, were considered. These 
techniques have eppllcatlon to nonlinear dis- 
tributed syr terns In which control saturation con- 
straints are specified. The overall direct 
search technique considers an assessment of per- 
formance based on the entire period of operation 
and le Iterative, The other method, e simplified 
non-iterative search procedure, yields a 
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piecewise-constant ffuboptimal policy based on an 
instantaneous performance measure evaluated at 
the end of each time increment. 

The tubular reactor startup problem was studied 
by using the overall direct search technique. 

The resulting optimal control policy closely 
ressembled that obtained using a distributed 
maximum principle and the value of the per- 
formance Index was almost identical. The overall 
direct search technique was somewhat less complex 
to program than the maximum principle, however. 

It was actually more time consuming because many 
complete solutions of the state equations — one 
for each trial control level at each time step — 
were required for each overall Iteration. The 
ability of the method to handle state variable 
constraints was demonstrated by imposing a maxi- 
mum reaction temperature constraint. 

The simplified direct search technique was 
employed to determine a subcptlmal startup con- 
trol policy for the tubular reactor, the 
objective being to minimize the Integrand of the 
time Integral of the overall objective functional 
at the end of each time Interval. The resulting 
control policy closely approximated those 
obtained by a maximum principle approach and the 
overall direct search method and yielded an 
almost identical value for the performance Index 
based on the whole period of operation. The 
mathod was also shown to ha capable of dealing 
with state variable inequality constraints as 
demonstrated by treating the constraint on maxi- 
mum reaction temperature. 



Because of the massiveness of the computation in- 
volved with a maximum principle and the overall 
direct search technique, it is limited to off- 
line use in computing optimal open-loop control 
and state trajectories based upon the anticipated 
transient behavior of the process over the tlmo 
span of Interest. Also both the distributed mix- 
imum principle and overall direct search tech- 
nique can be used as a standard of comparison for 
evaluating less complicated sub optimal approaches 
such as the simplified direct search technique 
which has on-line control possibilities. 
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Regulatory control of distributed svst«**nii subjected to loa«l disturbance* is considered 
by using feedforward and state measure control configurations. Dynamic comjsm- 
sation of the feedforwartl signal is at'eomplished with i lead -lag function, the time 
constants of which are determined by means of a numerical search technique. 
Compensation of the state measure signal is provided by the distributed nature of the 
process itself, Kxit temperature regulation of a tubular heat exchanger acted upon 
by velocity and inlet temperature disturbances is considered as an application for 
feedforward control. Considerably better performance is obtained with the a Id it ion 
of dynamic com|>ensatinn to the feedforward signal. State measure control is applied 
to the exchanger for a feed teui|>erature U|>set and the effects of sensor location on 
outlet |»erformance are investigated. An optimal sensor location is determined which 
minimizes the integral-square error at the outlet. 


1. Introduction 

Two types of control applicable to regulation of linear systems, or ayateina 
which can be linearized about an o|>erating point, are to be examined in thia 
work. One ia feedforward control and the other ia atate measure control. 
Both approaches use system measurements to provide corrective control 
action to compensate for disturbance inputs. The former implies that dis- 
turbances are sensed at the inlet before they can affect the process and the 
latter involves the measurement of the disturbance response at some point 
within the system. A numerical search procedure will be applied to the 
synthesis of optimal compensation for the feedforward signal. For state 
measure control, the effect of sensor Hun on the dynamic system response 
will be investigated. 

The methods are employed to obtain a desired control of a tubular heat 
exchanger by manipulating the steam temperature in a surrounding jacket. 
If the wall capacitance of the tubular heat exchanger is significant, it is necessary 
to perform an energy balance on the wall, resulting in an additional equation 
coupled with the energy equation for the process. Optimal control of a change 
in set-point will be considered for the tubular heat exchan^vr, using dynamically 
compensated feedforward control, the manipulated variable ' ring the jacket 
steam temperature. Regulatory control will be evaluated with the exchanger 
acted upon by load disturbances, both for feedforward control with optimally 

f Communicat jd by Professor L. T. Kan. This study was supported in part by KAMA 
Grant Ko. NGR- 17-001-034, and by the Air Force Office of Scientific Research, Office of 
Aerospace Research, United States Air Force, under Contract F44S20~6tMM>20 (Themis 
Project). 

} Present address : The Bcmlix Corporation, Kanss* City, Missouri. 
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designed dynamic compensation and state measure control with the transducer 
optimally located. 

Some attention has been given to the practical asjw»cts of instrumentation 
and state feedforward feedback control of distributed precedes. Watts (Ifififi) 
used a frequency domain approach to find optimal feedforward thermocouple 
locations in a plug-flow heat exchanger with distributed heating. Parseval’s 
theorem was employed to obtain the mean-square output error due to input 
forcing with known s|>ectral density. Using promotional ontrol only, he was 
able to find interior spatial locations which made the mean-square error 
stationary. Licht ( Ifiofi) also considered a similar problem for a counter-current 
plug-flow' heat exchanger and used c conjugate gradient minimization scheme 
to find sensor locations which minimized the output mean-square error, (liven 
a number of probes at pre-s|* cified locations, he was also able to find optimal 
weights to he given each probe. 

McCann (1%3) has considered a lime domain approach for finding optimal 
probe locations and optimal weighting tor multiple probes for a heat exchanger 
with axial diffusion. This involved a search on an analogue computer with the 
original system equation represented by a set of simultaneous ordinary 
differential equations. 

2. Regulatory control of distributed systems 

The techniques presented in this paper are applicable to com|>ensutiou for 
load changes which upset the system resjionse from its desired steady-state 
ojiernting |H>int. These disturbances may Ik* initially localized and propagate 
through the system such as a feed t e m | »erature upset, or may occur simul- 
taneously at all |K>ints as in the ease of a How* velocity fluctuation. 

In many distributed processes, although control must !>e extended over the 
entire spatial domain, the |>erforinance of the system is appraise at a single 
|K>int, usually the exit. For example, the jierformance index of a tubular 
reactor may be a function of the exit concentration of one of the reactants -or 
it may be desired to regulate the outlet tenqierature of a tubular heat exchanger 
about a given set-j>o!nt. The discussion herein pertains to such systems. It is 
also assumed that control action, although distributed in its effect, is initiated 
by a single, lumjKxl input. 

Conventional feedbaek eortrol systems are sometimes inadequate for 
regulator)' control of distributed processes. For example, consider a process 
in which it is desired to regulate the quality of the output stream. A localized 
load disturbance may enter the process at the inlet, but the feedback trans 
ducer will not sense the upset until the disturbance response pro|>agates 
through the system and begins to occur at the exit. Then, as control action is 
applied to offset the disturbance, dead time and lag in control response create 
a poor transient exit i»sponse and make it difficult to regulate the exit stream 
effectively. 

However, if it is possible to sense ? he disturbance at the inlet (or its response 
upstream from the exit), then this information may be utilized to initiate 
control action in advance of the arrival of the disturbance response at the cx r t. 
In this way, the control response can be made to match the disturbance 
response more closely, resulting in better control of the output quality. 
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3. Feedforward control 

Consider the feedforward control schematic for a distributed process shown 
in fig. 1. A vector of disturbance inputs is sensed at the inlet to the process 
and fed forward to a control computer. The computer also has. as an input, 
the set -point signal. 

Fig. 1 
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(b> State measure control 

Feedforward and state measure control configurations for 
tubular heat exchanger. 

In designing a feedforward control system, the usual approach is to consider 
the steady-state and transient aspects of the response separately (Shinskey 
1968). Accordingly, the function of the feedforward computer is first to calcu- 
late the value of the manipulated variable necessary to produce zero steady -state 
error under the influence of the disturbance. Then, dynamic compensation of 
the control signal is effected so that the transient deviation die3 out in some 
optimal manner. Dynamic compensation is necessary because of dynamic 
imbalances between disturbance and control responses. 

One method for dyvamic compensation of the control signal, where dead 
time in the disturbance response is not appreciable, is a simple lead-lag function 
(Shinskey 1968). The output, 0(<), is: 

0(t) = 0/ L l+^-exp(-«/r ft )]. (1) 

where 9 $ is the steady-state value of the manipulated variable and r tt and r 6 are 
the lead and lag time constants, reaoectively. 

In cases where dead time is a factor in the disturbance response, the lead- 
lag signal can be effectively combined v. ith pure time delay. The control output, 
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delayed by an amount t fh can be written: 

, . «Jl+ Tj '~- h exp [-(t- t„)jr h ] | , (/ - 1,,) > 0. 

«• ('-**)«>• 


( 2 ) 


Optimal design of the lead-lag compensation involves determining the lead 
and lag time constants such that the controlled system response is optimal 
with respect to some performance index. A procedure is developed here for 
performing a parameter search to determine the optimal time constants using 
the method of conjugate gradients due to Fletcher and Reeves (1964). A flow 
diagram for the overall search is shown in fig. 2. 

Although gradients of the performance index with respect to the parameters 
to be searched are required, difference approximations can be used where 
analytic expressions are not available. For systems under consideration here, 
it is necessary to compute the full solutions to the system partial differential 
equations each time the performance index is evaluated or a gradient 
computed. 

Constraints on the parameters or on the manipulated variable can be 
accommodated by the use of appropriate penalty functions in the performance 
index which penalize excessive excursions from the reference values. 


4. State measure control 

Instead of sensing the disturbance at the inlet as in feedforward control, 
consider now the measurement of the disturbance response within the system 
and using this information to provide corrective control. A complete appraisal 
of the disturbed state would entail measuring the entire profile. However, it 
has been shown (L?cht 1966, McCann 1963), that good regulation can be 
provided by basing the state assessment on just a few points or even a single 
point along the spatial axis. Herein, state measure control is considered in 
terms of a single state measurement at some point within the system. 

The state measure control scheme presented here is shown schematically in 
fig. 1. As noted by McCann (1963), 3tate measure control is both feedforward 
and feedback. It is feedforward in that the disturbance response is measured 
ahead of the regulation point and this information used as an input to the 
controller. It is feedback in the sense that the effect of control action can be 
sensed at the measure point. 

State measure control appears most useful in cases for which the exit 
response to a disturbance is slow in comparison to the response due to control 
action. By proper location of the probe, it is possible to utilize the distributed 
nature of the system for dynamic compensation so that the conUoller may 
consist of no more than a proportional mode. 

As in the case of feedforward control, the steady -state portion of the 
response is considered separately from the transient. This consists of computing 
the steady -state proportional gain, which, multiplied by the steady-state value 
of the suppressed state deviation profile at the measure point, restores the exit 
state to zero steady-state error under the effect of the disturbance. 
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5. Provision for feedback 

Both feedforward and state measure control are open -loop with respect to 
the controlled variable, i.e. the actual error at the exit regulation point is not 
used to provide corrective control action. For this reason the accuracies of the 
systems are susceptible to changing parameters, model inaccuracy, inaccuracy 
of load measurements, errors in computing components, etc. This indicates a 
need for a feedback signal to eliminate steady-state offset. 

The feedback controller would include the integral mode to provide the 
long-term accuracy required but would not be expected to contribute signifi- 
cantly to the rapid initial correction. For this reason, in the examples presented, 
the feedback portion has been omitted from the transient computation. 

6. Examples 

6.1. Outlet temperature regulation of a tubular heat exchanger using feedforward 
control 

To illustrate feedforward regulatory contro' theory, consider the problem 
of regulating the outlet temperature of a single-pass shell-and-tube heat 
exchanger. The control objective is to maintain the tube-side outlet tempera- 
ture at a fixed set-point with the system subjected to load disturbances. These 
load disturbances are assumed to be fluctuations in the feed temperature and 
the mean flow velocity. The manipulated variable is taken to be the steam 
temperature in the shell, which is assumed to be a function of time only. 


6.1.1. The mathematical model 


The mathematical model of the tubular heat exchanger with axial diffusion 
is derived. A simple single-pass shell-and-tube heat exchanger is considered. 
A liquid stream enters the tube of the exchanger and is heated by convection 
from the inner wall. Heat is supplied to the tube by means of condensing 
steam in the jacket. 

In deriving the mathematical model, the following assumptions are invoked : 

(1) System parameters are uniform and constant with respect to time. 

(2) Axial heat diffusion and mixing are significant for the tube-side stream. 

(3) Steam temperature is a function of time only. 

(4) Tube-side temperature and velocity are constant with respect to radial 
distance. 


(5) Heat capacity of the tube is finite. 

(6) Tube temperature is constant with respect to radial position. 

(7) Axial heat conduction in the tube is negligible. 

(8) Outer shell effects can be neglected. 

An energy balance taken over a differential section dl of the tube-side of the 
exchanger yields: 


di\ _ e*T, 
dr ~ BP 



■ hyjP l 

CpiPt-A i 


(fl-Ti), 


while taking an energy balance on a section of wall of length dl gives : 


dT 

dr 


n h Z % ( , r.-r w )+ h ** o P 'j-{T l -T w ). 

° pw Pw A w ^pw Pw A w 


(3) 
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( 6 ) 


The system is subject to the following boundary conditions: 

-^i- =},&(<>, t)~ T /] at / = 0, 

( 3 L : T 1 = o at. I = L. 
cl 

Equations (3) and (4) are non-dimensionalized by introducing the following 
quantities: 

Mean residence time: r r = Ljv sec. 

Axial Peclet number: p = vL/Z), 

Dimensionless time: ( — r/r r . 

Dimensionless axial distance: x = / />, 

Dimensionless liquid temperature : = TJT r 

Dimensionless wall temperature: = TJT r , 

Dimensionless steam temperature: 

Other parameters: 


* = TJT r 

1 A 


«•( 


T i 

1 

r 21 

1 


Pi ^ l 


S'*C 


C ii W - PtrA 


^ h 


sec 


-l 


T 22 


sec 


-l 


The system equations thus become 
du x _ 1 fiu 


p dx* 


du x T r 


T r n . T *«. . 

« r 21 r 21 


The dimensionless boundary conditions are : 

bu^t) 


ex 

b Uj ( 1,0 


— <) - it^] at x - 0, 


= 0 at x = 1 . 


(7) 

(8) 

( 9 ) 

( 10 ) 


The numerical values for the exchanger used in this study are assumed 
to be: 

P = lb, 

r r = 3 sec, 
t x = 3-69 sec, 

Tji = 2*65 sec, 

T|| = 1*05 sec, 

T r ® 1000 °R, 
u x f «= 0*530 t 
0 - 0*795. 


„ ; iPy/tC. * ' ■ 

, ' 4 ^ }■> v * • 1 '* •_ ' 
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The time constants for the system were determined experimentally by Cohen 
and Johnson ( i9fi6). 

6.1.2. Perturbation equations 

Consider the following perturbation variables defined as deviations from a 
steady-state operating point: 

ri 2 (.r,0 = a 2 {xj)-u 2 fx)< 

8(t) = 6(t)-6 ir 

«i'(<) = VW-Wi/. 

v(t) = v(t)-v„. 

If the following parameters are taken to be eonstant, i.e. 

T r = L I V *' 

ft = v„ LjD, 

eqns. (7)-(10) can be written: 


cu x 1 c 2 u x V ( U 1 T r . 

= o 7.7.2 - - 7- + - («2 - «i). 

ft fj C*t V £ C X Tj 


cu, 


ft = "(0- tt 2 ) + - - («! - «„), 


r 22 


r 21 


Pt.,^0 at x.O, 

x . i. 

cx 


( 11 ) 

(12) 

(13) 

(14) 


The steady-state profiles ii lt (x) and u 2t (x) corresponding to the operating 
point must satisfy the following equations : 


1 d*u t du % r « , 4 

h _ ~ J* + a: \ « o, 

fi dx dx r x v 2 ' 1,7 

”-( 0 ,- « 2 .) + (»‘l. “ «*,) = 0 . 

T »* T il 


(15) 

(16) 


with the boundary conditions : 

— ^=j8[«i.(°)-«i/ ] at * = °< (17) 

= 0 at * = 1. (18) 

Subtracting eqn. (15) from eqn. (11) and eqn. (17) from eqn. (13) yields: 

edi _ie , H 1 (v 8u t du^ r 

~H-p'W\v, (19) 


rf«u(U 

dx 


dx 


• (20) 
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Thus with the introduction of a velocity perturbation, non-linearities are 
introduced. These non-linear terms may be linearized in a first-order Taylor 
series about the operating point, i.e. 


v <u l du lt v du Xi (U x 
v H (X ~ dx v H dx cx 9 

1 o,o*«i.(0)+ ® «,,(0)+tJ 1 (0,o, 


( 21 ) 

( 22 ) 


V . . V 4 A 4 

uJ £ Ui / + - u x f + vd. 
v u J V M * 


(23) 


Using the above approximations and subtracting eqn. (16) from eqn. (12) and 
eqn. (18) from eqn. (14), the following system of linearized dimensionless 
perturbation equations results : 


* l „ * , r „ v du x 

+ r, ( “ 1 “ " l) - 'dx ' 

u, = •— (0 - 6 t ) + — (d, - «,), 

t 22 t 21 

subject to the boundary conditions : 

A 

**t,(0, t) = t) - V] + P £ [«,.(0) - «i/] at x = 0, 


(24) 

(25) 

(26) 


tt u (l,0 = 0 at x=l. (27) 

Here, the disturbance inputs are uj(t) and tf( ), the feed temperature and velocity 
fluctuations, respectively. 

The steady-state behaviour of the system is described by the following 
ordinary differential equation : 




dx * r dx -V ^v. dx 

subject to the boundary conditions : 

= /3[^i. ( 0) - t u t] K(0) - «,/] at x = 0, 


du 'j^ = 0 at x = 1, 

dx 


(28) 

(29) 

(30) 


where 


T *i 


T n+ r *i 

Equation (28) is now reduced to state space form by letting : 


* 1 , “ Vv 


dx 


y%- 


To obtain the steady -state control variable 6 , which provides zero steady -state 
exit error under the influence of the disturbances, a new state variable is 


r 
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introduced, he. 

K = y 3 - 

The complete system of equations is thus : 


rf .Vi _ 


dr 


= Vr 


<ly-i 


.v,du u 


. 0, 

dx 

with the boundary conditions : 

A 

= PM®) - “i/l + £ ,7 [“1,(0) - «i/] at x = 0 , 

3/a(l) = 0 at x = 1, 

1. 


(31) 

(32) 

(33) 

(34) 

(35) 

(36) 


y,(l) = 0 at x 

Using computed values of du h (x)ldx , eqns. (31)~(33) may be solved using 
Runge-Kutta integration and superposition as outlined in Hahn (1969), 
yielding the appropriate steady-state control value, and the suppressed 
deviation profile ^(x). Temperature deviation profiles are shown in fig. 3 for 
a feed temperature upset of uf = 1 and a velocity change of tf/r, = 0-1. 

Fig. 2 



Flow diagram for conjugate gradient method of finding 
optimal lead-lag parameters. 

The performance criterion to be minimized is taken to be the integral -square 
error of the fluid temperature deviations at the exit. This can be written : 


s- IWer* 


’ V- r jf ■ ' ' . 

7 * *•. “7'< * ‘ * v (' “ 4 . *■ 


( 37 ) 






-o 


372 


D. R. Hahn et al. 


The solution of the transient perturbation equations given by eqns. (24) and 
(25) are solved forward in time t = 0 to t = t f by decoupling them and iteratively 
applying the implicit difference method. 



x 

Steady *«tate deviation temperature profiles for fe<*d temperature 
and velocity disturbances. 


Equations (24) and (25) are most conveniently solved by finite-difference 
methods. However, for parabolic equations care must be taken in applying 
explicit difference approximations that stability is ensured. In order to circum- 
vent this stability problem, the implicit scheme due to Crank and Nicolson 
(Forsythe and Wasow 1965) is considered here. This method introduces more 
complexity into the difference model but guarantees stability for any increment 
of time, thus reducing the number of time increments required. 

In applying the Crank-Nicolson methoa the spatial axis is discretized into M 
increments of equal length Ax so that Ax = 1 /M. Time discretization is effected 
by solving the difference equations at equal time increments At. The solution 
u(m f n) denotes the value of the dependent variable at the spatial location 
(m - 1) Ax and at time (n - 1) At. 

The partial time derivatives are approximated by taking forward differences 
between the (n- l)th and nth time steps, i.e. 


u t [w(m, n) — u(m y n - 1)]. 


(38) 


For spatial discretization, implicit difference operators are constructed for the 
first and second spatial partial derivatives by taking central differences, 
averaged over the (n- l)th and nth time steps, i.e. 

u xx *(if*/2) [n(m + l,n) — 2«(wi,n) + ii(m~ l,n) 


+ u(m+ l,n- 1)- 2u(m,n- 1 ) + u(m- 1, ,t- 1)], (39) 

u x a(Jff/4)[n(m+ l,n)-«(w- l,n) + w(m + l,n— 1 )~n(m- l,n— 1)]. (40) 

The above difference operators have a discretization error on the order of (Ax)* 
(Forsythe and Wasow 1965). The solution of eqns. (24) and (25) is greatly 
simplified by ‘decoupling* the component equations. This is done in the ith 
equation at the Jfcth iterative solution by setting: 




0, j#i. 


( 41 ) 
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The dependent variable u is also averaged over the (n - l)th and nth time steps: 

u *|[w(m,7*) + tt(7w,7i- ijj ^ 2 ) 

1 he difference approximations for the first derivative terms occurring in 
the boundary conditions at x = 0 and x = 1 are taken to be three-point forward 
and backward differences, respectively: 

I ^0 * (if/2) [ - d(3, n) + 4tf(2, n) - 3i/( 1 , «)], (43) 

Wr I, 1 * (-V/2) [3d ( J/ + 1 , n) - 4w(if, 71) + t2(if - 1 , »)]. 1 44 ) 

Bv substitution of the above difference operators given by eqns. (38)— ( 44) 
into ecpis. (24)-(27), the following sets of difference equations for the Ath 
iteration are obtained : 

[*■ V+M 

= -A l u l (l,n-l)-D 1 H l {2,n-l)-C 1 u l l J,n-l,- ^<*-»»( 2, n) 

~ 2/3 + UI W ‘ /(n) " !,; ~ ’ 

A - 1 ,n)-B l ti l (m,n) + C x + 1 , w) 

- ~A 1 u l (m- 1,m- 1)-D, u x (m,n- lJ-C, u l (m + 1, re- 1) 

-E t ' k -"(m,n) wi = 3 J/-1, 

Ml - &x {k) (M -l,n) + [Z3 1 + |C,] «,<*>( J/, «) 

= — 1,» — 1 ) — Z), ^J,( Jl/, n — 1)-C 1 w,(il/+ 1 ,h- 1) 

-J &,«*-"( 

1 


iJ 2 <Af) (7«,n) = 


A 


where 


—D t u t (m,n— 1)- Tr < 1 ‘*- | *(iM,n)-- T ^-^(»-l)] 
T « T ia J 

»i = 1 1, 


. M* M 
A '=2fi + 4’ 


B t = 


1 

Jr_ 

j/* 

1 

“2 

T 1 

$ 

A< ’ 

1 

Zt_ 

.1 JV 

1 

“2 


2t„ 

A*’ 

if* 

M 


2]8 

4 

» 


1 


3/* 

1 

2 T| 

T + 

A<’ 

1 


.1 JV 

1 

2 

T *a 

2r,i 

+ Af’ 


E^(m,n) - Tr u xk-v {mtn) _M du^n) 
t. v. dx 


(«> 


(46) 
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The end-point values, <<i(l,w) and ti t (M + 1, n), are determined respectively 
from the following boundary equations: 


«,«*»( l.n) 


3/ 

2/3 + 33/ 




43/ 

2/3 + 33/ 


«?,'*’( 2,n) 


u l ik) (M + l,n) = — 1, «). 


(47) 

(48) 


In performing the computations, time and spatial increment sizes used were 
0*05 residence time and 0*05 dimensionless distance unit respectively. Terminal 
time t f was taken to be 3 residence times. 


Fig. 4 



Outlet temperature responses to a step feed temperature upset for 
various effective axial diffusion coefficients. 


Fig. 5 



Comparison of open -loop disturbance and control outlet tempi rat u re 
responses for a step feed temperature disturbance. 

6.1.3. Feed temperature disturbance 

Consider a unit step upset in feed temperature, i.e. * 1. The uncon- 
trolled disturbance responses at the exit are shown in fig. 4 for several effective 
diffusion coefficients. A comparison of the uncontrolled disturbance response 
with the corresponding step control response required for zero steady-state 
error is shown in fig. 5 for 0 - 10. As seen in fig. 6, with uncompensated 
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feedforward control, an increase in feed temperature results in an initial 
decrease in exit temperature due to the relatively faster response to control 
action. 

Thus coin j>ensat ion is ; 'Heated which provides for less energy to he 
delivered to the system dun g the initial transient than that required for zero 
steady -state error under the effect of the upset. 

Fig. a 
o 

- 1 

0,(1) 

-•2 



Of 


1 r 
5 . 


0 L-l 



t 


Uncompensated controlled outlet temperature response to 
a step feed temperature disturbance. 


Due to the relatively slow exit response to the disturbance, it was necessary 
to incorporate a pure time delay in the control. The design procedure was to 
fix the delay at some increment of time, jAf,j « 0, 1,..., and for this delay 
compute the optimal time constants, r a and r 6 , using the method of conjugate 
gradients. In difference form, the control is thus: 


0(n-j) 


«.{ i + T %^*e« P [ - <» ' Lr»“] ). 


(49) 


{<>, (» — 1 —j) < 0 , 

where 6, represent* the **r.*iy -state control necessary to completely cancel the 
disturbance at the exit. 

The control yielding the lowest value of the performance index was deter- 
mined, using a time delay of 0* 15 residence time and lead and lag time constants 
of 0-0246 and 0-0937, respectively. The optimal control trajectory and corre- 
sponding exit response are shown in fig. 7. The ISE for the optimally com- 
pensated response waa 0-00102 compared to 0-01552 for the uncompensated 
case. 


6.1.4. Velocity disturbance 

For a velocity disturbance, the situation is different ngure 6 shows the 
uncontrolled exit response to a step velocity disturbance, £jv, » 0-1, and the 
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corresponding step control response required to completely eliminate steady- 
state error. In this case the disturbance res|>onse leads the control response. 
The controlled but uneoni|>ensated exit res|>onse is shown in tig. 9. 

Fig. 7 
1 r 




t 

Outlet temperature response to a utep temperature disturbance 
using optimal feedforward lead lag control with delay. 


Fig. 8 



Comparison of opendocp dwt * - ,* and control outlet 
< < anperat ure response* for a *i* p * eloc.ty disturbance. 


It is thus desirable to provide dynamic compensation to the controller to 
enable the delivery of more energy to the system during the transient than 
required for zero steady-state output error under the influence of the distur- 
bance. 

To limit the magnitude of the control deviations, the performance index is 
modified to include a weighted penalty on excursions from the steady-state 
value, i.e. 


S 


jV.(M)]*+y{0(O-0.] , K 


( 


(60) 
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Unrom|»'nHatcd controlled outlet t temperature rcHjimwc to 
a step velocity disturbance. 


In this case, the difference representation of the lead-lag com {tenanted 
feedforward signal is : 

0(») = 0„jl + T,, ~ T6 «xp |_( n -^*)4<Jj {5I) 

Using the conjnghte gradient technique, optimal lead-lag time constants 
were computed for several amounts of control weighting. The results are as 
follows : 


y 

s 

T . 

Tfc 

Uncompensated 

0-70811 

1 0000 

1*0000 

0*1 

0-46461 

0*6080 

0*0110 

001 

0 - 1.1216 

0*3746 

0*2571 

0001 

0 03239 

03357 

0*1909 


Figure 10 shows the optimal control trajectory and corresponding exit 
response for y * 0*001. 


6.2, Outlet temperature regulation of a tubular heat exchanger using state measure 
control 

Consider again the problem of outlet temperatuie regulation for the tubular 
heat exchanger, this time by means of state measure control. The load distur- 
bance is assumed to be a unit step increase in feed temperature. It is proposed 
to offset the disturbance effect by placing a sensor at some axial position within 
the process and using only the proportional mode with the gain adjust *u lor 
xero steady -state offset at the outlet, rnder the influence of the disturbance. 

The suppressed steady-state deviation profile u u (*) and the corresponding 
steady -state control 6 $ are determined by solving eqns. (31}-(3A) with 4 - 0 and 
4 x f m 1 . One* these are known, the proportional gain 0 m for any measure 
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i 

Outlet temperature rvHponw to « .cUx*ity ilmturlmnee iwin# 
optimal fwtlfonvanl Icatl la^ control (y - 0-001). 




(52) 


point jr n ran be computed from the relation: 

K 

A plot of the rcaultant gain as a function of sensor location is shown in fig. I 1 . 

In order to appraise the dynamic |>erformanee of the exchanger under state 
measure control, a closed-loop digital simulation may be accomplished using 
the system difference representation, eqns. (45) (48). Since the control is 
projjortional to the instantaneous value of the r,tale variable at tfc* measure 
point, i.e. 

ty)-0»*i(*«..<). (53) 

the difTerenee form at the nth time step for the frh iteration may be written: 

6 tk \n) m 0 M d,‘*-*>(m\ n), (84) 


where m' is the 8(>atial node corresjionding to the measure mint x m . The 
iteration is repeated at each time step until convergence is attained. 

Computation was performed over 3 residence times using time and spatial 
increments of 0-08 residence time and 0-08 dimensionless distance unit, reflec- 
tively. Upon computing the transient exit response at each spatial node, the 
exit integral-square error was computed using Simpson’s integration. To 
penalize high gains obtained for larger a penalty term was added to the 
performance index, i.e. 

S - £{[<»( 1 , 0]* + ylty) - #,]*} dt. (86) 

Figure 12 shows the resulting value of the performance index as a function of 
the sensor location, wi.n and without the penalty. 
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Figure 13 shows the control trajectories obtained from the simulation study 
for several sensor locations. The corresponding exit responses are shown in 
Figure 14. 

In Figure 14 the top response indicates that the transducer is too close to 
the inlet. The control action is premature, causing an excessive undershoot 
of the set-point before the disturbance response starts to occur. 


Fig. 13 



0 2 -4 8 8 10 12 1*4 1*6 1 8 2 0 2 2 24 2 8 2*8 3 0 

t 

State measure control trajectories for a step feed temperature upset. 

Fig. 14 
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0 * *4 -8 *8 10 1*2 14 1*8 1 8 2*0 2-2 24 2*8 2*8 3*0 

t 

Effect of sensor location on the outlet response to a step feed temperature 
upeet using state measure control. 

The bottom response shows the effect of having the transducer too far down 
stream. The control response is too slow, resulting in excessive overshoot, due 
to the disturbance response. Also, with the transducer close to the exit, the 
proportion* i geki becomes high and cycling or instability may ensue. 
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The best response, in the sense of minimum integral -square error (with 
control penalty), is shown in the middle. The probe is located such that there 
is initially a small undershoot due to control action, followed by a small over- 
shoot as the disturbance response arrives at the exit. 

7. Conclusions 

Two control schemes were investigated for regulating the exit state of a 
linear distributed system or one exhibiting linear behaviour about an operating 
profile. These were feedforward control in which a disturbance measurement 
was fed forward to a controller to indicate corrective action and state measure 
control in which the disturbance response was measured at a point within the 
system and used to generate a corrective signal. In practice, each would be 
used to provide rapid initial disturbance correction, but used in conjunction 
with a small amount of integral feedback from the regulation point to eliminate 
steady-state offset. Optimization for the feedforward scheme presented con- 
sisted of determining optimal values for lead and lag time constants whereas 
for state measure control, optimization involved the determination of an 
optimal measure point. 

A computerized design procedure was demonstrated for determining optimal 
dynamic compensation for the feedforward signal. The method of conjugate 
gradients was used to compute optimal lead-and-lag-time time constants to 
minimize an index of performance. For the heat exchanger example presented 
compensation for a feed temperature disturbance required a time delay, in 
addition to the lead-lag compensation, to be inserted in the feedforward loop. 
For a velocity disturbance, it was necessary to impose a penalty on control 
effort in the performance index to constiain in the control to a physically 
realizable level. 

A closed-loop (with respect to the measure point) digital simulation tech- 
nique was devised for simulating the response of a tubular heat exchanger to a 
step increase in feed temperature, using state measure control. The scheme was 
an implicit one in which the transient state at a given spatial point was multi- 
plied by a proportional gain to determine the value of the manipulated variable 
in the state equations. A one-dimensional search was performed to find the 
best measure point in the sense of minimizing the exit integral-square error. 
Using the resulting optimal measure point, state measure control provided 
somewhat better performance than compensated feedforward control for the 
same disturbance. 

For distributed system regulation, state measure control has the advantage 
that the distributed nature of the process itself is utilized to provide dynamic 
compensation for the control signal and hence a simple proportional controller 
may suffice for this portion of the control. On the other hand, the specification 
of the proportional gain requires the knowledge of the nature of the disturbance. 
If multiple disturbances are likely to be present, it may be impossible to predict 
the exit error based on a single-point state measurement. In such situations it 
would seem advisable to use a feedforward configuration, thus isolating the 
disturbance inputs. Feedforward control would also be indicated in situations 
where the response to control action is slower than the disturbance response. 
Under these circumstances, the lag created by basing control action on the 
disturbance response would only degrade the performance. 
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ABSTRACT 

An optimal wall temperature control of a single-duct heat exchanger 
Is studied. The wall temperature which Is the control variable Is assumed 
to be uniform in space but a function of time. The system considered is 
a distributed parameter system where the fluid temperature Is a function 
of time and a spatial coordinate. The contrci Is to force optimally 
the temperature profile of the fluid from the initial state to a new 
desired steady temperature profile In a finite time. Two different 
performance Indexes are considered. One is the integral of the absolute 
deviation of the system temperature profile at any moment from the new 
desired steady state profile and the other is the integral of the square 
of deviation of the system temperature profile at any moment from the new 
desired steady state profile. Both are to be minimized. Optimal solutions 
are obtained by two methods* namely, linear programming and a variational 
technique. 


*Thls study was supported in part by NASA (Grant No. NGR-17-001-034) and 
AFOSR (Grant USAF08R F44620-68-C-0020) . 
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INTRODUCTION 

A heat exchanger is often an important element In a variety of 
engineering systems including the life support system in space vehicles. 

It is used to absorb the heat generated by the adsorption bed for COj 
removal, the metabolic heat of the human body, the heat generated in air 
conditioning units, and others. 

In this study, optimal control of a single tube heat exchanger with 
a capability of controlling its wall temperature as a function of time Is 
considered. However, temperature of the fluid in the heat exchanger Is a 
function of both time and a spatial coordinate. In other words the heat 
exchanger considered in this work is a distributed parameter system which 
is usually described by a partial differential equation or a set of such 
equations with time and one or more spatial coordinates as Independent 
variables. A dynamic lumped system, on the other hand, Is usually 
modeled by a set of ordinary differential equations which Involve time 
as the only Independent variable. Basically, all physical systems possess 
the spatial distribution of dependent variables, but often the variables 
are uniform in space or they may be considered to be Independent of space 
without excessive loss of information. Under such circumstances a system 
is said to be lumped. However, for many heat exchangers, a lumped 
approximation is Inadequate and It is necessary to take into account 
spatial varlatlont of the variables to provide sufficient detail regarding 
system behavior. 

Specifically, the problem in this work is to find a certain pattern 
of the wall temperature variation with respect to time ao that the fluid 
temperature will be changed from one steady state profile to the nearest 


possible vicinity of a new steady state profile in a finite time. 

Usually the wall temperature can not exceed a certain temperature con- 
straint that is imposed on the control variable. 

Yang [6] solved the transient response of fluid temperature in a 
single tube heat exchanger subject to wall temperature variation. Koppel 
et al. [2, 3] studied the optimal control of similar systems. The con- 
straint that was Imposed to the system is of the integral type instead 
of control saturation. They approached the problem based on the conjecture 
that the control variable is related to the system temperature by a certain 
relationship. Sakawa [4] was perhaps the first to use ’ linear programming 
for obtaining the optimal control policy of the distributed parameter 
system. Huang and Yang [1] used this technique to solve a heat exchanger 
problem with internal wall heat generation as the control variable. Both 
wall and fluid transient temperature distributions depend on the internal 
heat generation. 

In the present study both linear programing and a variational tech- 
nique are employed. The variational technique employed here is similar 
to that used by Koppel [2, 3], but an analytical control function is 
obtained without Koppel' s conjecture. 

System Equations . The system considered in this work is shewn in 
Fig. 1. It consists of a duct through which a coolant flows steadily. Its 
temperature distribution is changed from an initial state to a final desired 
state. The following assumptions are made [7). 

a) The well temperature may vary with time but uniform along the 
x-axls. 

b) The fluid temperature and velocity ere uniform along the radial 


direction. 
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c) Axial heat conduction is negligible in fluid. This is a 
reasonable assumption when the Peclet number exceeds 100. 

d) The heat-transfer coefficient is constant along the x-axis and 
time. This assumption is experimentally verified to be 
reasonable [6). 

e) The fluid Is incompressible and all fluid properties are constant. 

f) The flow channel has constant cross-sectional area. 

g) The temperature of the fluid entering the duct is constant. 

With these assumptions, the energy balance gives rise to the following 
differential equation for the fluid [2, 7]. 

p A Ax ' C p ^ " u p A C p Y |x'+Ax' " u P A C p Y| x « + h p Ax’(y w - Y> (1) 

where y and y w are the transient fluid temperature and wall temperature, 
respectively, p is the coolant density, is the coolant specific heat, 

P is the wetted perimeter of the tube, A is the flow cross-sectional area, 
h is the heat transfer coefficient between the wall and the coolant. Ax' is 
the differential distance along axial direction, and t is time. The initial 
and boundary conditions are 

y(0, x') - y 0 (2) 

Y<t,0)-y 0 (3) 

By introducing the new dimensionless variables 

T - (Y - Y 0 )/Y 0 

6 * (y w " v 0 )/y 0 

x » x'/L, 0 < x < 1 

t ■ t u/L 

K , -IIL. 

* P A Cp u 


nd letting 
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Ax 0, 

system equations. Equations (1) through (3) , 

can be transformed 

H + £- K < e - T > 

(4) 

T(0, x) - 0 

(4a) 

T(t , 0) - 0 

(4b) 


The analytical solution of equation (4) subject to the boundary conditions 
was obtained by Yang [7]. 

Performing the Laplace transformation on equation (4) subject to the 
initial condition given by equation (4a) , one obtains 

sT + ^ - K( 6 - f) (5) 

Integrating this equation subject to the trar.s formed boundary condition of 
equation (4b) 

f(s, 0) • 0 

leads to 

T(s, x) - ~ (1 - a"** e- X )6 (6) 

The inverse Laplace transformation of aquation (6) gives two solutions In 
two domains of real time 

* > t, T(t, x) - K /* a~ K<t “° e(Od€ (7) 

0 

x < t, T(t, x) • K / e“ K * t "^e(OdC - Ka"** /* * • 6 ( 0*1 

"0 0 

0 0 

• K /* a“ K(t ’ 5) e(C)<i« (•) 

t-X 


\ 7 % ' -o 


r.d^r . v* rre^rtoiiA-LV rrca-Ltaa -ir :a 


~*niv*-r-*r.ir*> -r.^:*«r :r.a» ^rr> xuUt. ”0, 


. * ; r ^rtv r^sn^ir.*c.ir^ -nrnt:L_*t. . :c; _rr i :^:n :a 

i 


***< *> Aintmliln^ * ?:* ^n ^rt.irmnca -iwex. 


7ie Tam .Tiu.ac.JU ‘art-* 


-f>> ^ -i -^»>n *»* h** teamer-Arura- -< r.. jn:_cn _a a :unec^m it 

- , TA 4 » W \ \ f 

?Vu* 1 **h; ,'^rt i*s* ic-*ce fling i^smeracur^ inr,^, \. , -An 

v» v* w-virm the f.i a»*_ng jc^aav *cgca x^if *r^nc^xl «mcwn 

^ ">» j ‘-ip vvwvtar > vwut i c ian I , 


^.n-r. 

1/ 


v c> - \ v c - - f 


■Sr,+y* \ (« t'n* da^lrad final wall ccoparacorc. Th« solution of th« abort* 


^)i»a! (6^ U 


T^*) * *,<1 - •“**) 


Two performance Indices ar« Co b« minimized . One is th« 
lot egral of tha sbsoluta deviation of tha ay a tea temperature from ch« 
deal rad now steady taaparatura profila ^(x) at tha final tlaa, t { , which 


fa pi van by 


I - / I T(tj, x) - T d (x)|dx 


and lha other la tha Integral of tha oquara of davlatlon of tha ay a tan 


taaparatura Iron T^x) at tha final r.<na, which la given by 

1 2 
• • / lT(t f , x) - T d U)l* dx 


(10a) 
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It is worth recalling that the flow through the system is of the 
slug ilow or plug flow type. Therefore, If the final time is greater 
than the mean residence time, l.e., if t^ >, 1, the control maintained 
at 6^ for 0 £ t <_ t f> will lead to the final system temperature profile 
T(tf, x) which is exactly equal to T^(x) [compare equations (8) and (9)], 
and this in turn will always give rise to the minimum attainable 
performance index of zero. Therefore, the only case oi practical interest 
is the case with t^ less than one residence time, l.e. t^ < 1. 

While the two performance indexes given by equations (10) and (10a) 
are quantitatively different, qualitatively both represent the 
same entity, namely the integrated deviation of the systems temperature 
profile from the desired temperature profile. 

APPROXIMATE SOLUTION BY LINEAR PROGRAMMING 

Since the Integrand of the objective function given by equation (10) 
is linear in the state variable, the veil-developed linear programming 
approach can be used to obtain «n approximate solution. In order to 
utilize the linear programming approach, equation (10) is linearized in 
a step-wise manner by means of Simpson's rule of integration as follows: 

S - /* | T(tf , x) - T d (x)|dx 

% c t |T(t f , Xj) - TjCxpl (11) 

where 

x^ • i, for 1 • 0, 1, 2, ...» m 

c 0’ c «*5* 

c i * c j Vi * S 

and 


M I 


c 2 - c 4 « . . . - c m _ 2 - ^ 


Equation (11) contains the bummation of all linear terns and thus 
the linear programming approach can be utilized (1, 4j. Sines the dimensionless 
inlet coolant temperature is always zero, the first tern of the summation in 
equation (11) can be droped. In other words, the Index of Stamatlon, i starts 


from one instead of zero. 
Let 


|T(t f , - e .i + e pi 


+ e . , i • 1, 2, m (1- 


where e , e , i - 1, 2 , . . . , * are non negative variables which satisfy 
si p i 

the following relationship. 


T(t f * * 4 > - T d ( Xi ) ■ « pi - « -4 . 


1*1,2, . . . , m (13) 


e - 0 and T(t f , - T,^) - - e #1 if T(t f . x^ - T,^) < 0 


e#1 - 0 and T(t f , Xl ) - T,^) - e pl 
e pi - e #1 - 0 if T(t f , Xj) - T^) - 0 


if T(t f , Xj) - T d (x t ) > 0 


i ■ If 2 f • • • » 


By introducing thaaa now variables, aquation ( 11 ) can ba axpressad as 


* ’ t i x ♦ V U5> 

Equations ( 7 ) and (8) at the final tins can ba apprexlnated by dividing 
tha total transient tins, t f . into n segments and asstaing tost the 6 la 
constant in each sub interval. Thus 


«*r V * * A tj 'j 


for 1 m 2 9 • ••! si 



where 


0J - 9(t) for tj_, <, t <_ tj, 

t. = j t /n for j - o, 1, .... n, 
J * 


and A^j are constants. 

The linear programming model which will yield the optimal policy o 
the system can now be formulated. 

Minimize 


I 

i-1 


C 1<%1 + %!> 


( 15 ) 


subject to 


T(t f , x t ) - TjCj) - . pl - e sl . 


e. < e 

J — max 


V *J 1 ° 


i * 1 » 2 * • • • » ® 

j * 1 » 2 » •••»o 

i s 1) 2, * • » i m 

j “ 1» 2, • • • * n 


( 17 ) 

( 18 ) 
( 19 ) 


where 6^^ Is the maximum allowable wall temperature. 

From equations (7), (8), (9), and (16) through (19) , 

that the problem can be stated as follows: 

Minimize 

m 


l 

i-1 




♦V 


it can be seen 


subject to 


I I 
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A,-©, + ... + A. 6 - e , + e . 

11 1 In n pi si 


A. .6. ^ ... t A 0 0 
21 1 n 


- e ~ + e . 
p2 s2 


■ W 

■ T d< X 2> 


A .0. + i . . + A 9 
ml 1 mn n 


-e + e ■ T,(x ) 
pm sm dm 


e e 9, > 0 for all i, 1, 
si pi j — J 


< 0 

— max 


< 0 

— max 


i-m: 

gs* **** 


? 



This Is a standard linear programming problem which can be solved by the 
linear programming simplex method [4 J. An IBM subroutine In Mathematical 
Programming System/360 (360A-C0-14X) , Linear and Separable Programming, is 
used for the computation. 

SOLUTION BY A VARIATIONAL TECHNIQUE 

Because the performance index given by equation (10a) is of the quadratic 
type, the linear programing approach can not be used for its minimization. 
While the quadratic programing can be employed to obtain an approximate 
solution, It appears that use of the variational technique Is more appropriate 
because of the possibility of obtaining an exact or analytic solution. 

The systems equations considered here are equations (4), (4a), (4b), 
and (10a). 

Consider now a small change 60 In the control variable 6. The resulting 
Incremental response 6T In the variable T of equation (4) must satisfy 

the following linear perturbation differential equation. 


I ! 
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I 


I 


c 




6 Tt * " 6 'T' + K(60 “ 6T) (20) 

o t oX 

The variational initial and boundary conditions are 

6T(0, x) ■ 0 at t ■ 0 (21) 

6T(t, 0) - 0 at x - 0 (22) 


Now the control function 6 which gives rise to the minimus of the 
performance index given by equation (10a) must be determined. In order to 
obtain necessary conditions for optimality, a relationship must be found which 
expresses the variation of the performance index, 6S, in terms of the control 
perturbation, 66. 

The Increment of the performance index, equation (10a) , due to the 
system temperature variation is 

6S - / 2 1 (T ( t , x) - T.(x))6T]l dx (23) 

0 a c 

By adjoining the variational system equation, equation (20), to the vari- 
ational performance index, equation (23), one obtains 

1 1 ^f »T 3T 

as- / 2[ (T - T ,)6T] | dx - / / z[6 4“+6 4““ K60 +K6T]dt dx (24) 

o d t-t f 0 0 dt (JX 



where z(t, x) Is the adjoint variable. 
Because of the identities of 




at 


rubstitutlon of equations (25) and (26) into equation (24) yields 


(25) 


(26) 


6S 


/ «« - *■ - / 0 ' ' I it ( * 4T > + -k <*«> 


- <!f ♦ If - *«)«T - Kxaejdt dx 


(27) 


X 
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The first term in the second integral of equation (27) is now integrated 
with respect to t from t * 0 to t = t^, and the second term with respect 
to x from x - 0 to x = 1, so that each term in the integrand involves either 
the variation 6T or <* 10 . These give 

3 ^f 

„/ <'«>dt - U«Tl t . 0 (28) 

/ ii (z4T)d ' 1 ' l ‘ 6T| x-0 <29) 

After some manipulation and noting that 6T(0, x) * 0 and 6T(t, 0) ■ 0, 

the following result is obtained. 

1 C f 

«S - I ( (2T - 2T. - z)6T] dx - / [z6Tl . dt 

0 d c c f 0 x i 

+ f 1 / tf ((“f + I s - Kz)6T + Kz69]dt dx (30) 

00 9C dx 

lo eliminate terms not depending explicitly on 56 from the integrand of 
the third Integral of equation (30), it is stipulated that the adjoint 
variable satisfies the differential equation* 

H + (31) 

This is accomplished by choosing the adjoint boundary conditions such 
that the coefficients of unknown endpoint variation 6T vanish. For the 
coefficient of 6T in the second integral of equation (30) to be aero, 
one has 

*<t, 1) - 0 (32) 

For the coefficient a»f AT in the first Integral of equation (30) to be aero, 

one has 
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* 


t 




z(t £ , x) - 2T(t f , x) - 2T d (x) (33) 

The resulting variational performance Index, equation (27), can now be 
written as 

1 C f 

6S - / / Kz(t, x)60 dt dx (34) 

0 0 

Assuming that for the adjoint variable z(t, x) Is piece-wise continuous, 
equation (34) can be rearranged by Interchanging the order of integration 
as follows: 

t f 1 

«S - K / [ f zdxj«e dt (35) 

0 0 

The analytical solution for the adjoint variable is obtained along 
the characteristic line along which the following general relation exists. 

3 : dt 3z dx 
at ds + dx ds 

length along the characteristic line. Comparing equation 
relation yields 

- 1 . 

- 1 , 

-'iz 

Integrating these aquations, one obtains 



dz 

ds 


where s Is the 
(31) with this 


dt 

ds 

dx. 

da 

dz 

ds 
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* 


c 


t 


where t^, x^, and 2 ^ are values of t, x, and 2 respectively at the 
starting point. Tne argument of the boundary condition given by 
equation (52) is represented by line segment CD in Fig. 2. The argument 
of equation (33) is split into two regions because T(t^, x) has two dif- 
ferent expressions from equations (7) and (8). Line segment AB represents 
the argument of equations (33) and (8), i.e., for x <_ t ^ . Line segment 
BC represents the argument of equations (33) and (7), i.e., for t f . 

Now consider point Q in Fig. 2 , which is inside the line segment BC. 

At this point, tp » t^. Let 

t ■ t f - s (37) 

x - x Q - s (38) 

Then, eliminating s from these two equations, one obtains 

x Q - x + t f - t (39) 

Rearranging equation (37) yields 

s - t f - t (40) 

The slope of the characteristic line QP, (t - t f )/(x - x Q ) , can be obtained 
from equations (37) and (38), and is equal to 1. The same is true for the 
characteristic lines BO and CJ, which divide the argument of adjoint 
variable into three regions, i.e., regions I, II, and 111. Region I is 
determined from the boundary condition at AB, region II is determined 
from the boundary condition at BC, and region III is determined from the 
boundary condition at CD. Substituting equations (7) end (9) into equation 
(33), the boundary condition at Q becomes 
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t 


* 


*0^* x q^ 


tf K(p-t f ) -Kx 

2K f 6(p)e dp - 26.(1 - e U ] 

0 d 


(41) 


Then along the characteristic line QP, the solution for the adjoint 
variable can be obtained by substituting equation (39) into equation (41) , 
and equations (40) and (41) into equation (36). This yields 


for 


z(t, x) 


K(t-t f ) tf K(p-t-) -K(x+t f -t) 

e (2K / 9(p)e dp - 26.(1 - e 1 ] }, 

0 ® 


Since Q is an arbitrary point in the line segment BC, equation (42) is the 
solution for the entire domain of region II. At any arbitrary time, region 
II is inside the line segment FG In Fig. 2, i.e., t < x < 1 - + t. 

In the same manner, the solution for region I, i.e., x <_ t of EF, can be 
obtained by substituting equations (8) and (9) into equation (33), and by 
noting that x is changed to Xq because it is on the boundary point where 
t • t^, x - Xq. The resulting equation is then substituted into equation 
(36). Finally, replacing 8 in equation (36) by equation (40), one obtains 

K(t-t f ) t f K(p-t-) -K(x+t--t) 

*(t, x) - e 1 (2K / 6(p)e r dp- 26.(1 -e 1 ]} (43) 

t-x « 


(42) 


for 


0 < x < t. 


*'lnce the boundary condition for region III is zero, it can be seen 
from equation (36) that 

t(t, x) - 0 (44) 

for 

1 >, x > 1+ t - tj. 


Numerical Procedure Baaed on the Gradient Technique in Function 
Space . Because the control variable la constrained, and equation (1) is 
linear in the control variable, 6, it is impossible to let the gradient of 



. : It * -* 


Che Hamiltonian with respect to 8 be zero. The control variable will be 
of the bang-bang type unless singular control occurs. However, the 
iterative procedure by the gradient technique can be employed to obtain 
the optimal control policy even in the singular control case. In fact, 
a part of the control policy obtained in this work is singular. For a 
lumped-parameter system, the perturbed performance index is obtained for 
continuous control processes by the gradient in function space method ( 5 ] . 

The resulting expression is 

45 ■ o ,t£ I? <4(l)dt 

where H is the Hamiltonian. If one wishes to minimize the performance index, 

the gradient 3H/S0 is calculated and 68 is determined such that its direction 

is opposite to the gradient, l.e., 

• . 3H 

44 ' - • H 

where a is a positive constant. Analogous to this, the perturbed index 
given by equation (35) is 

*f 1 

6S • K / [ f zdx] 66dt 

0 0 

and thus the control variation may be given by 


60 • - <4 / zdx) 
0 


Integration of the adjoint variable along x, which appaara in this 
equation, can be accomplished by Integrating aquation (43) from x ■ 0 to 
x - t, integrating equation (42) from x-ttox-l+t-tf, and 
integrating equation (44) from x • 1 ♦ t - t f to x - 1. Thla yields 




< 


> 


t 


I 


1 K(t-t ) t t f 

r zdx ■ 2e { / [ 

0 o t-x 


K(p-t f ) 


{ f'[ f ' KO(p)e * dp - 6 d U-e 


-K(x+t f -t) 


) Jdx 


t £ K(p-t f ) -K(x+t f -t) 


+ / ' [K / 6(p)e 

t 0 


dp - 6 d (l - e 


)]dx} 


(46) 


Interchanging the order of integration and performing the integration with 
respect to x yield 


i K(t-t f ) 

f z(t, x)dx ■ 2e $(t) 

0 


(47) 


where 


*(t) 


tf K(p-t f ) t K(p-tf) 

(l- t<: + 1) / 6 (p)e dp - K / 6(p)e (t- p)dp 

f n 0 


V 1 - C t * ‘ * K 


K(t-t f ) 

f ]} 


(48) 


In computing the optimal solution, the following iterative procedure has 
been employed: 

(1) Assume a control pattern 8(t) “ 0Q(t). 

(2) Compute the fluid temperature T(t, x) from equations (7) and (8) 

(3) Compute the adjoint variable z(t, x) from equations (42), (43), 


(4) 

(5) 

( 6 ) 


and (44) . 


1 


C om pute the integration of the adjoint variable / *dx from 
equations (47) and (48). 

Let 60 ■ - a/ adx. Equation (35) will be 6S ■ - ^ 

0 0 
which is always decreasing. 

Change the control variable auch that 6 r . vised ^ " ®old^ + 
and repeat the whole procedure from step (2) . If ® j^vieed^^ 
exceeds its upper bound e ((i somewhere between t - a and t - b. 
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l 


1 2 
S - / [T(t,, x) - T\(x)rdx 

0 f d 

2 1 2 

- / [T d (x) - T d (x)rdx + / [T x (t f ) - T d (x)Pdx (49) 

0 t f 

Note that the first Integral of the right-hand side is zero. 

To find T^(t^) which minimizes the performance index S, the gradient 
of S with respect to has to be zero. 



1 

2 / (T. - T.)dx - 0 

‘ t 1 d 


(50) 


Since 


is uniform for t^ 



<_ x _< 1, this gives 
* d dx 


. . 1 , -K 

C t * K ( * 



(51) 


Substituting into equation (49), the minimum performance index will be 


■in S - / |T. - e.(i - t" lt,t )l 2 dx 

*t 1 4 


/ [(Tj - « d ) 2 + 29 d (T 1 - + »l •"““‘idx 

C f 

26 

< T 1 - e d ) 2 (1 - t f ) - -p (T a - e d )(e" K - e f ) 


®d . -2K _2Kt f. 

- 2K ( * - * > 


(52) 


While the case with the quadratic performance Index as given by 
equation (10s) Is the main concern of this section , the above argument Is 
equally valid for the performance Index given by equation (10). There 
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always exists a point, x ■ In the region tj < x < 1, where the fluid 
temperature, T^(t^), will change from T^(t^) > Cx) for x < x^ to 
Ti(tf) < Tj(x) for x > x r Then the performance index becomes 

S « / | T(t,, x) - T.ldx 


t f i 

- / |T. -T.|dx+ / (T.-T.)dx + / (T. - T.)dx 

0 dd tf Id x dl 


03 ) 


In order to minimize S, its partial derivative with respect to x^ and 
must be zero. Taking partial derivative of S with respect to Tj^ and letting 
it be zero yield 


3T X “ (x l " V U - x x ) - 0 


This result implies that 


x x - U + t f )/2 


(54) 


Taking partial derivative of equation (53) with respect to x^ and 
equating the resulting expression to zero yield 


Hi - *i - w - >w - • ° 


or 


-Kxi 

T 1 " T d (x l ) “ 6 d (1 “ # > 


Substitution of aquation (54) Into this equation yields 

-K(l + t f )/2 


T, - 6.[1 - e 


] 


(55) 


Combination of equations (9) and (55) shove that 


*!-**• v* - • 


-u -«*♦**>« 


) 


(56) 
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The minimum performance Index of equation (53) becomes 

(l+t f )'2 -K(l+t )/2 1 -K(l+t )/2 „ 

s- / V -• + V« -• 


-Kt f . -K(l+t,)/2 1+t, -K(l+t,)/2 

Vi* -h i -»d'-2 £ - t f>‘ 


C 




1+t. -K(l+t,)/2 6. _ -K(l+t,)/2 

+ 6 d ll "“T‘ le + K te " e 1 

6. r ' Kt f ~K(l+t-)/2 
--£[e‘ K + e f -2e f J 


(57) 


In the unconstrained case, the optimal control is infinite at t • 0 + 
and this is immediately followed by the desired final steady state control, 

6 * Oj. The optimal control with constraints on control may be analogous 
to this control for the unconstrained caae. Therefore, it is assumed that 
the control is on the upper constraint boundary initially and then move to 
the inner part of the control domain. Provided this assumption la correct, 
one is required to locate the switching time, t - t^, at which the control 
la moved from the upper bound to the inner part of the control domain, and find 
the control policy after this switching time, l.e. for t > t^. 

For the control to be optimal, the variation of the performance Index, 
equation (35), must be Identically aero. For the period t < t^ when the 
optimal control la 8 • 6^, two possibilities exist. One possibility Is 
1 

/ sdx - 0 

0 

so that the control variation <6, as given by equation (45), la sero. The 


other la 



2 ? 


q/ zdx < 0 

so that the control variation, £0, has to be positive. However, since 
the control is already at the upper boundary, and the control is con- 
strained, £6 has to be zero. In this case, the variation of performance 
index, equation (35), is zero again. 

For the portion of the optimal control not on the control boundary, 

only the first case can happen, l.e., 

1 

/ zdx - 0. 

0 

For the period t > t^, therefore, 66 must be zero at the optimal control. 
From equations (A5) and (47), one obtains 

♦ (t) ■ 0 for t >. tj, (58) 

£ to satisfy 

1 

J zdx » 0. 

0 

The Integral equation, equation (58), where 4(t) is expressed by equation 

i 

(48), can be solved by twice differentiating it with respect to t. Note 
that the intervals of integrations in the right-hand s.de of equation (48) 
are from p - 0 to p ■ t^ for the first term, and from p • 0 to p ■ t for 
the second term. The interval of the first integration will be divided into 
two intervals ranging from p ■ 0 to p ■ t^ and from p • t^ to p » t^. The 
interval of the second integration will also be divided into two Intervals 
ranging from p » 0 to p ■ and p • t^ to p - t. 

For the period of t < t^, the optimal control Is i(t) » 8 MS > Substi- 
tuting this value Into equation (58) and differentiating the resulting 
| equation twice with respect to tins, t, one obtains 

0(t) • 8j, for t > t j. 
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c 


<Kt) is 0 at t * tj for the optimal control. Therefore, by 
substituting the optimal control policy (6(t) ■ for t < t^, 

0(t) • e d for t >_ t^] Into equation (58), replacing t by t^, and inte- 
grating the resulting equation, one obtains 


e 

max 


K 


K(t x 

e 






e 

max 


K 



1 + H> 


(59) 


This equation can be solved for t^ by iteration. For the unconsl.ained 

case, where 0 «, t. is zero, 

max x 

A NUMERICAL EXAMPLE 


Numerical values of the parameters of the system, the final 
dimensionless time t, - t ^ u/L, the dimensionless heat exchanger coefficient 
K, the desired wall temperature, 6^, and the maximum allowable wall 
temperature, 0 , are taken as follows: 


t 


f 


0.5 


K - 1.0 


6 d - 0.5 



4.0 


The performance Index given by equation (10a) will be denoted by S^, 


i.e. , 


Sj • t x) - T,] 2 dx, 


% 


and the performance index given by equation (10) be denoted by S^, i.e., 

#2 “ *) - Tj|dx. 

0 





0 


I 


24 


Approximate Optimal Solution by Linear Programming . As stated 
previously, this approach is applicable to the case with the objective 
function Figure 3 shows the approximate optimal control pattern 

obtained by the linear programming method. This pattern is not strictly 
of the bang-bang type. Sakawa [4] and Huang and Yang [1] obtained 
similar results by using the linear programming method to solve a distri- 
buted parameter system. In this work, since the control is assumed to be 
a constant inside each time subinterval, the resulting pattern is discrete, 
which is in contrast to the continuous nature of the results obtained by 
Sakawa [4] and Huang and Yang [1]. 

Figure 4 shows the corresponding temperature distribution. This 
approximation was made by subdividing the tube into 20 segments. The time 
increment employed here is At ■ 0.01, l.e., 50 subinterval in time axis for 
t f » 0.5. Since the integration in the performance index formula is approxi- 
mated by Simpson's rule, the points in Fig. 4 of x ■ .4, .45, .5 are connected 
by a smooth curve. S 2 corresponding to this approximate optimal solution 
L, 0.01576. 

Variational Technique . As stated previously thu technique is mainly 
applied to the case with S^. However, for the corresponding unconstrained 
problems, both cases of and S 2 can be solved analytically with equal 
ease. The values of and Sj are calculated from equations (57) and (52), 
respectively. The resulting final optimal system temperature profiles are 
given in Figures 5 and 6 . In these figures, the solid lines in 
the region of x <_ 0.5 and the dash lines in the region of x ^ 0,5 arc the 
desired temperature distribution*, given by equation (9), 
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In Figure 5 for the case of minimizing S^, the optimal temperature 

distribution is T(t_, x) = T,(x) for x < 0.5 and T(t r , x) = T_ * 0.26135 

f d f L 

for x > 0.5 which is obtained by equation (51). These are plotted by solid 
lines in Figure 5. The minimum as given by equation (52) has the value 
of 0.0005909. The value of S 2 corresponding to the temperature distribution 
given in Figure 5 is 0.0148641. 

In Figure 6 for the case of minimizing S 2> the optimal temperature 
distribution is T(t^, x) ■ T^(x) for x < 0.5 and T(t^, x) ■ * 0.2638 

for x > 0.5 which is obtained by equation (55). These are plotted by 
solid lines in Figure 6. The minimum as given by equation (57) has the 
value of 0.0148385. The value of S 2 obtained by the linear programming is 
0.01576 as stated in the preceding sub-section. This result is anticipated 
because it is greater than the unconstrained optimal value. The temperature 
distribution in Figure 5 corresponds to the S 2 value of 0.0148641. This 
value is greater than the present S 2 value of 0.0148385 corresponding to 
the temperature profile of Figure 6. This result is anticipated because 
the temperature distribution in Figure 5 corresponds to the minimum which 
is 0.0005909. The value in Figure 6 is 0.0229 which is greater than this 
value. 

Figure 7 shows the exact optimal control trajectory which minimizes 
S^. The switching time of control, t^, is obtained from equation (59) as 
t x - 0.02914392. 

Figure 8 shows the temperature distribution at various transient time. 
Figure 9 shows the corresponding transient distribution of the adjoint variable. 
The dash line In Fig. 8 is the desired final temperature distribution, T^, 
and Is obtained from equation (9). The solid lines are the temperature 
distribution at various time along the optimal control trajectory. These 
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lines are obtained by substituting the optimal control policy of Fig. 7 

into equations (7) for x _> t and into equation (8) for x ^ t. 

The lines in Fig. 9 are the distribution of the adjoint variable, 

z(t, x) , at various time along the optimal control trajectory. These lines 

are obtained by substituting the optimal control policy in Fig. 7 into 

equation (43) for x t, into equation (42) for t<^x<^l + t - t^, and 

into equation (44) for l_>x>l + t-t^. Each equation 

represents a continuous line with continuous derivative. Equation (43) 

represents the curves with positive derivatives. Equation (42) represents 

the curves with negative derivatives and is continuously connected to the 

lines of equation (43) at x - t. Equation (44) represents the curves on 

the x axis and connected to the curves of equation (42) by dash lines. 

has the value of 0.000631104. While the same control pattern produces 

S 2 - 0.0158354, the S 2 value from the linear programming part is 0.01576. 

1 

Figure 10 shows the variation of f zdx with respect to time, subject 

0 

to the control obtained in Fig. 7. For t < t^ , it has a negative value, but 

the corresponding control lies on the upper limit; for t >_ t., it is zero. 

1 

This result conforms with the previous analysis, i.e., / zdx < 0 for 

1 0 
t < t, , and / zdx » 0 for t > t. . 

- 1 0 “ 1 

Figure 11 shows the approximate optimal control policy obtained by 
the numerical iterative procedure based on the gradient technique. The 
reason it ievlates from the exact optimal pattern as obtained by the 
analytical method is that the exact control pattern switches at t - .029143, 
which can not be realized by using time Increment of At ■ 0.01 by the 
present numerical iteration method. The value of is 0.000658405. For the 
control pattern of 6 ■ 4.0, i.e., maximum allowable value, for t < 0.03 
and 6 ■ 0^ • 0.5, for t > 0.03, the corresponding has a value of 0.000660493, 
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while the corresponding to the exact optimal control as obtained by 
the analytical method is 0.000631. The deviation of the temperature 
and the adjoint variable distribution between the analytical method and 
the numerical iterative method are negligibly small. These plots are 
neglected. 

CONCLUDING REMARKS 

In this work, practical aspects in computation and solution of the 
optimal control problem of a first order distributed parameter system, 
more specifically a heat exchanger, has been emphasized. 

First it has been shown that linear programming can be advantageously 
employed to obtain an approximate optimal control policy for the case with 
an Integral objective function, the Integrand of which is linear in the state 
variable. 

Both analytical and numerical procedures based on the variational 
technique have been successfully employed to determine the optimal solution 
for the case with an integral objective function, the integrand of which is 
quadratic in the state variable. 

In connection with this variational approach. It has been shown that 
solution of the corresponding unconstrained problem which is less complicated 
than the original constrained problem, is indeed useful and beneficial in 
evaluating various approaches to be taken in solving the original constrained 
problem. 
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NOMENCLATURE: 



2 

flow cross-sectional area, ft 
dimensionless constant 
dimensionless constant 
specific heat, 

dimensionless variable defined by equation (14) 
dimensionless variable defined by equation (14) 

Hamiltonian function 

heat transfer coefficient between tube wall and the coolant, 

ft 2 hr 

dimensionless integer 

dimensionless constant, — 

P Cp A u 

heat exchanger length, ft 

dimensionless integer, total number of heat exchanger segments 

dimensionless Integer, total number of subintervals for t^ 

wetted perimeter, ft 

Sg ■ performance indices, dimensionless 

Laplace transformation variable, dimensionless; distance along the 
characteristic line, dimensionless 

dimensionless time; t^, switching time; t f , final time 

coolant dimensionless temperature; T, Laplace transformed temperature 
T^, desired coolant temperature 

coolant velocity, ft/hr 

heat exchanger axial distance, dimensionless 
adjoint variable, dimensionless 


Subscripts 

1 - summation along x>axls 

j ■ summation along time axis 


m * total number of increment along x 

n * total number of increment along t 

Greek letters 

a = dimensionless positive constant 

Y « coolant temperature, °F 

Yq ■ constant, °F 

Y w * wall temperature, °F 

Ibm 

p - density, —3 > integration variable 

r “ time, hr 

0 - dimensionless wall temperature; 0^, desired wall temperature; 

0, Laplace transformed wall temperature; 0 , maximum wall temperature 

r max 

$(t) - dimensionless, defined by equation (48) 

6 - variational operator, dimensionless 
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Approximate optimal control policy obtained 
by the linear programming for the case of 

S, . 








Fig. 4 Approximate final optimal temperature 

distribution obtained by linear programming 
approach for the case of Sz . 





Fig. 5 Optimal final temperature distribution 

without control constraints for the case 
of Si . 
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Fig. 8 Temperature distribution along the 
analytically determined optimal path 

for the case of Si . 
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Fig. 1 1 Optimal control policy by the gradient technique 
based on the numerical iterative procedure for 
the case of Si . 
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August 29, 1969 
ABSTRACT 

Literature on the optimal terminal control of linear distributed 
parameter systems by means of the linear programming technique is 
reviewed. 

Some suggestions are made which may facilitate computational 
aspects of the problem. A brief account of the theory of linear pro- 
gramming is also given. 


A 

This study was supported in part by NASA (Grant No. NGR-17-001-034) and 
AFOSR (Grant USAPOSR F44620-68-C-0020) . 


The main purpose of this report is to review critically and 
exhaustively literature on the use of linear programming for the optimal 
terminal control of the linear distributed parameter system. Because 
of the availability of well developed standard computer subroutines 
[for example, IBM subroutine, Mathematical Programming System/360 
(360A-CO-14X), Linear and Separable Programming], linear programming can 
be a very powerful technique, if we can convert a problem to a standard 
linear programming problem. Zadeh and Whalen [1] appear to be the first 
to use the linear programming method for solving various Imped optimal 
control problems of the lumped system. Sakawa [2] is probably the first 
one to apply this approach to the linear distributed parameter system. 

This paper is divided into three sections. In the first section 
linear programming is briefly explained. The second section shows how a 
problem of optimizing the linear distributed differential system with a 
linear performance index can be reduced to a standard linear programming 
problem. In this section a method for optimizing such a system is proposed, 
which is based on Lesser and Lapldus's [3] approach for solving the time- 
optimal control problem of a lumped system by linear programming. Their 
approach may be adopted for the more complex linear distributed parameter 

systems. Several practical examples of the linear optimally distributed 

• * 

parameters systems are reviewed in the third section. 
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THEORY OF LINEAR PROGRAMMING 

Consider the general system described by the following linear 
equations . 

*11*1 + “12*2 + ••• + *ln x n ' b l 


Vl*l + %2 X 2 + 


+ a x • b 
inn n m 


( 1 ) 


where the x's are the unknowns, the a's and b's are the given constants 
and n > m. The problem of optimizing the system is to find the x's which 
satisfy the condition 

Xj 0 , j " 1* 2, . . . , n, (2) 

and minimize the objective function 

z • c,x, + c^x. + ... + c x , ( 3 ) 

xi 4 z n n 


where the c's are constants. These x's are called the optimal solution of 
the system. 

To obtain the solution by analytical means is very difficult if not 
impossible. However, the problem may be solved numerically by linear programming. 
One of the most commonly used techniques r linear programing is the so-called sim- 
plex method developed by Dantsig [4). It is an Iterative procedure for determining 
the optimal extreme point end may be explained in the following manner. 

The Gauss-Jordon reduction method is applied to equations ll) and (3). 

The first step of this method ie to divide the first expreaslon of equation 
(1) by a^^* The next step le to eliminate terms containing x^ from the 
remaining m-1 expressions. This le accomplished by subtracting each one of 
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the other expression from the first expression after a simple manipulation. 
The second expression is then divided by the constant which normalizes 
the coefficient «f x^. Following the same procedure as that for the x^ 
terms, terms containing are eliminated from all the other expressions. 
Repeating these procedures to all the m expressions and eliminating all the 
x^» i ■ 1, .... m, from equation (3), we obtain 

f 9 * 

x, + a, . , x . , + . . . + a, x * b, 

1 l,m+l nrfl 1," n 1 


x 2 + a 2,m+l x ort-l + 


+ a 2,n \ * b 2 


x + a , • x , . + ... + a x - b 
m m,m+l m+1 m f n n m 


(4) 


Vi Vi + • 


. + C X - * - Z-, 

n n 0* 


where a^, b’, and c* are the modified values of a^, Dj, and c^, respectively 
and Zq is a constant. 

One of the many possible solutions of equation (4) may be expressed as 

1* 2 , ...» m, 

(5) 


“ b i* 

for 

i - 1. : 

* 0, 

for 

i » nrfl 


where x^, i - 1, 2, m, are called the basic variables, and this set is 
called a basis. The value of the performance function is 


* • 


( 6 ) 


A basis which satisfies aquation (2) is said to be feasible. For the basis to 
be feasible, it is required that b^ _> 0, for i • 1, 2, ...» m. Now, from the 
sign of c’, j ■ nrfl, ..., n, in aquation (4), one can determine the baals for 
the adjacent extrema point for which the currant value of the performance 


4 • in -»3 


function tends to decrease, that is, the value of the performance function 

may be reduced by shifting one of the nonbasic variables with negative Cj 

into the basis. Let this nonbasic variable be defined as c', where m+1 < s < n. 

s — - 

By shifting the x 's column to the right hand side, equation (A) may 

S 

now be rewritten as 


x. + a! x_ 0 + ... + a! _ x_ - b' - a! _ x. 


l,m+l m+1 


_ A — U4 — O . A 

l,n n 1 l t s s 


*2 + *2,»H Vl + ••• + 0 + ••• + *2,n x n ’ b 2 * *2,. % 


( 2 ) 


t 


x + a' . , x + ... + 0 + ... + a' x ■ b ' - a' _ x 
m m,m+l m+1 m,n n m m,s s 


c'. x .. + ...+ 0 + ...+ c* x - * - 2 - - c* x 
m+1 m+1 n n 0 s s 


Since x is the only nonbasic variable allowed to deviate from sero, 
8 

the basic variables and performance function are x g -dependent, 

* A * b’ - a^ g x g , 1 - 1, 2, .... m, (8) 


2 ■ 2- + C X_ . 
0 S 8 


(9) 



Here, the a^ g can be any finite value. From the condition x^ 21 0, x g must* 
in accordance with equation (8), satisfy the condition 

. i t _ 

k i - v. \ ^ °- 


or 




(10) 


By designating Integer 1* which yields the minimum value of b.'/a! for 

* *»• 

a^ > 0, as r we can write 


b r K 

• min — *— ■ max x. 


.^.>0 ‘ i *» 


Ki 

1. 


(ID 
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The ratio b /a is the maximum x , which would reduce x to zero. This 
r r,s s r 

implies that the performance function may be reduced by replacing x by x 

r s 

as a new basic variable. As a result, the new basis effectively accomplishes 
a jump from the original extreme point to an adjacent one with a sub- 
sequent decrease in the value of 7 . In order to replace x by x in equation 

r s 

(4), the Gauss-Jordon reduction is applied to equation (4) to form another 
new cannonical form. 

>* ** «* 


x, + a. x 
1 l,r r 


+ a l*m+l Vl + + 0 + + a i”n x n * b l 


I * 


t 


} 


I* , • * . . A . . I * . » * 

*r,t x r + Vl Vl + "• + 0 + ••• + *r,n \ ‘ b r 


a'* x + x + . _ , , x . , + ... + 0* ... + • '* x - b'* 
m,r r m m,o+l nrfl m,n n m 


(12) 


c r* x r + Vl Vl + • • • + 0 + • • • + c „* * n 


z - z n - c * b ' * 
0 s r 


This procedure ia repeated until all coefficients of the performance 
function become positive. In the meantime, z cannot be reduced by the in- 
crease in the nonbasic variables. Therefore, the solution is the optimal 
basic solution. 

The principal disadvantage of the simplex method ia that, in the process 
of numerical reduction, many numbers have to be computed and recorded. These may 
not all be used in the succeeding computational steps or may be used only in 
an Indirect way. However, the process is made necessary because it is not 
known a priori which numbers are needed and which are superfluous. 

In order to eliminate this complexity, a revised simplex method has been 
developed [A]. Instead of computing all the coefficients a! i ■ 1, 2, ...» m, 
j » m+l, n, the revised simplex method needs to compute the a! , 




* 


4 


*, "4 *■# 


T3 


6 

i ■ 1, 2 , . .., m only. A linear programing subroutine based on the revised 
simplex method is available [for example, Mathematical Programing SystemO60 
(360A-C0-14X) , Linear and Separable Programming). Since this revised 
method Is basically Identical in principle with the original simplex 
method, the detailed procedure of the revised simplex method Is omitted. 


i ■ , 






OPTIMIZATION OF DISTRIBUTED PARAMETER PROBLEM 

1. Integral Representation of State Equations . 

Sakawa [2] is probably the first one to apply linear programming to the 
solution of linear distributed parameter problems. This section generally 
follows his approach. 

The state equation of a linear distributed parameter system generally 
can be represented by the partial differential equation 

If - f 0 (x, t) * + f 1 (x, t) If + ... + b(x, t) u(t) (13) 

The state equation together with its boundary conditions may often be repre- 
sented by the Integral equation 

*(x, t) • /* g[x, X] u(X)dX + h(x, t) (14) 

0 

Suppose that a measure of the deviation from the desired state at the 
final time given by 

L, • • 

S ■ / | *(x, t f ) - * d (x)|dx (15) 

is defined as the performance criterion or index of the system. Optimisation 
(minimisation) of the system as represented by equations (13) through (IS) can 
be accomplished by the linear programing approach. 


♦ 
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Approximating the continuous control function u(t) by a number of 
discrete constants, 


u j * u (0 for c j_! 1 t <_ t j 

J C f 

t . - for j • 1, 2, . . . , n, 

J n 


(16a) 

(16b) 


equation (14) at the final time can be rewritten as [5] 


z(x, t,) » / g(x, X) u(X)dX + h(x, t f ) 

f 0 * 




n 

1 / g(x, X) u dX + h(x, t f ) 

j-1 C j-1 J 




E u. I g(x, X)dX ♦ h(x, t f ) 
j-1 J c j-l 1 


(17) 


Sakawa [2] originally used Simpson’s rule to integrate approximately equation 
(14), i.e.. 


where 


n 

six, t ) % I g(x, t.) u(t.) d + h(x, t f ) 
1 j«o J J J 1 




^2 " ^4 " * * * 




When the Integrand in equation (14) is continuous, this approximation gives rise 
to a sufficiently accurate solution. However, in the case of a discontinuous 
integrand, the accuracy of this approximation will be very poor. Use of 
equation (1?) does not give rise to such a difficulty even if u(t) is discon- 
tinuous ($). 


The performance index given by equation (15) can now be approximated by 
Simpson's rule as 


S = J | z(x, t f ) - z d (x)|dx 


m 


% Z c |z(x , t f ) - z,(x ) | 
i=0 


(18) 


where 


x. * — , for i = 0, 1, 2, 
I m 


t • • • m 


C 0 - C m ” 3m * 


r a r = 

C 1 3 


= 

C m-1 3m 


and 


c 2 * c 4 " * • 


2L 

C m-2 3m 


z(x. , t c ) in equation (18) can be evaluated from equation (17). 

X L. 

n 

z(x. , t f ) - Z u f g(x. , X)dX + h(x , t f ) 

1 j-1 J c j-l 

n 

- Z A., u. + h(x., t f ), 
j-1 1J J 

i - 0, 1, 2, ...» n (19) 

Let 

|*(x lt t f ) - * d (x 1 )| - e sl + e i * 0, 1 m (20) 

where e #i , a 1 » 0, 1, . m, are non-negative variables which satisfy 
the following relationships. 

*(x 1 , t f ) - * d (x t ) * « pl - « 8t . 1-0, 1 a, (21) 


9 


and 


e pi = 0, z(x if t f ) - z d ( Xi ) - - e si . 


if [z(x it t f ) - z^x^] < 0 


e sl ■ °' *<V - 2 d (x i> ' %1 


if [z( Xi , t f ) - z d (x 1 )]. > 0 


/ 


i 


( 22 ) 


i * 1, • • • i ni 


By introducing these new variables » equation (18) an be expressed as 


m 


S - l c. (e . + e_,) 


i-0 


I' si pi' 


(23) 


The linear programming model which *•>111 yield the optimal policy of 
the system can now be stated as follows: 

Minimize 

m 

S - l c.(e + 
i-0 1 P 1 81 

subject to 

z(x i , t f ) - * d (x i ) • e pi - e si , i ■ 0, 1, .... m 


u. < u 
J - max 


• P i- *.i- "j i °- 


1 ■ 0, lp ...pm 

j • 1* 2, • • . p n 


where u ^ y is the maximal allowable control value. The Inequality relation 

u. < u 
j — max 

can be removed by introducing a set of new variables e^ such that 
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a* *v 




i 


c 



u, + e . 
3 uj 


u 

max 


e u j i 0, j * 1* 2 , . . . , n 


By substituting z(x^, t^) from equation (19) into the above formulation, the 
problem can be restated as follows: 

Minimize 


m 


l . + e . ) 


1=0 


i v pi si 


subject to 


A-.u, +...+A rt u - e A + e . 

01 1 On n p0 80 


A, ,u, + ... + A, u - -e , + e 


'll 1 


In n 


'pi si 


A ml u l + • • * + A mn u n 


-e + e 
pm sm 


z d ( x 0 ) - h(x Q , t f ) 
* d <*|) " h * x l’ t f ) 

z d (x m ) * h( V t f ) 


u 


1 


+e 


ul 


max 


Si’ e pi’ ®Uj* U j " 0 » 


+ e * u 
un max 

1=0, 1, . . . , m 

J = l, 2, • • • » n 


This Is a standard linear programming problem which can be solved by the 
simplex or the revised simplex method. 

2. Discrete Time Representation of State Equations . 

The integral representation of the differential system, equation (13) , 
can be converted to the linear programming form without much difficulty. 
However, only a simple system with simple boundary conditions is amenable 
to the Integral representation. It Is, therefore, more advantageous to 


* ? ■ 



I - 1 
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convert the partial differential equation of a complex system to a 
differential difference equation instead of an integral equation. 

Very often a distributed diffusions L process of the process industries 
can be represented by a model containing completely stirred tanks connected 
in sequence. For such processes, an equivalence can be established between 
a mathematical model given by the differential difference representation 
and a physical model of the stirred tanks in sequence. 

By subdividing the system by m+1 segments, with the two half-sized 
segments at both ends, and lumping all the properties within each segment, 
the partial differential equation, equation (13), can be approximated by 
m 

z.(t) - Z a. . (t) 2 (t) + b . (t) u(t), i « 0, 1 m (24) 

1 j-0 3 3 

where 

z^t) - z(x 1 , t) 


Lesser and Lapidus [3] used the linear programing method to solve a 
time optimal problem of a limped system represented by this set of differential 
equations. They converted a continuous control function Involved in the 
system into a discrete-time function for approximation. We shall propose 
a scheme in which their approach is applied to the terminal control of the 
linear distributed parameter system. Approximating the continuous control 
function u(t) by a number of discrete constants, control functions, we have 

u j * u(t) Vi * e i c i 

tj - — J - 0, 1, ..., n 
The coefficient matrix [e^(t)] and [b^(t>] can be approximated by 
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A k ■ \ t a ij + 2 ^ a ij (t k-l^ 

b k - (b^t^) + b^tj^)}, k ■ b* 2 » •••* n 

Substituting the above relation into equation (24) yields 

z (t) = A k • Z(t) + b k u^, i * 0, 1, ...» m (26) 


This is a set of linear differential equations with constant coefficients, 
and the solution is 

Z(t k ) * exp(A k At) Z(t kl ) + / exp(A k s) ds • B k • (27) 

k k k 

where Z and B k are column vectors of [Zq, z^, z^] and [b^, b^, .... b^J, 

respectively. 

Let 

k k . 

G k - it exp(A^ At) • exp[At l A J ] *A 
1 J-i+1 J-i+1 j 

g k * 1 ^ k - 1, 2, ...» n (28) 

P. - / At exp(A k s)ds • B k J 

k 0 

By substituting these definitions into equation (27), the following set of 
equations Is obtained 

Z( tl ) - oj • Z(t 0 ) + ?J • «t 
Z(t 2 ) - «xp (* 2 it) [oj Z(t 0 ) + Pj Ujl + PjU 2 

• »o 2(t 0> + 5 1 • f l“l + ' Vz 

*“k> ■ 3 • i(t o> + j 2 6 5 • v u j 

5 <t() ■ «o • *<‘o> + j t 5 5 • f i • “3 


(29) 


*./'*< f 'u 


Replacing the matrix notation by its components yields 

Mtr) * 1 8?*? z 1 (t 0 ) + 1 I 1 8i’k Pjh u 4 
1 £ j«o 10 J u j-1 k-0 ’ J 



where 


h i + 1 A i i V 
i iml i.J J 


6“ - .nd - [pj[] 


i * 0, 1 i • • • , m 


The performance index, equation (15), is replaced by equation (18). This 
time discrete problem is then reduced to the same form as that given in the 
preceding subsection on the integral representation. Equation (30) is 
equivalent to equation (19) . The rest of the procedure for applying linear 
programming is the same as in the preceding section. 







i* ■■V 
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EXAMPLES OF DISTRIBUTED PARAMETER SYSTEM 
A. Heat Conduction System 

Sakawa [2] applied the linear programming method to the solution of 
a practical example of optimization of the linear distributed parameter 
system. The process considered by him is a one-sided heating of a metal slab 
in a furnace and is described by the diffusion equation [see Fig. 1] 


l q(x t t) _ 3q(x, t) 

a 2 at 

3x 


(31) 


where q(x, t) is the temperature distribution in the metal slab which depends 
on the space coordinate x(0 £ x <_ 1) and time t(0 <_ t £ T) . The initial and 
boundary conditions are given by 


q(x» 0) - 0 


3q(x» t) 


3x 


3q(x, t) 


3x 


x»0 


x»l 


- a{q(0, t) - v(t)} 


(32) 

(33) 

(34) 


where a is the heat transfer coefficient and v(t) is the furnace 

gas temperature. It la assumed that the gas temperature, v(t), has a first- 

order phase lag from the fuel flow, u(t), l.e.. 


+ 


dt 


v(t) • u(t) 


(35) 


where y is the furnace time constant. The performance index Is defined as 
the absolute deviation from the desired temperature profile at the final 
time T 

1 . 

s ■ Q f |q <*) - q(*. T)|dx ( 36 ) 


where q*(x) is the desired temperature profile. 
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This set of system equations is transformed into the integral repre- 
sentation by the Laplace transform. The resulting equation is 

t 

q(x, t) ■ / g(x, t-t) u(r)di 


q(x» t) 


x cos k(l-x) 

cos k - — sin k 
a 


e" k C + 2k 2 


cos (1 - x)B. 


. , 2 _2 W 1 1 + a x n 

i-l (k - 6 1 )(~ + — cos e i 


- 6 i C 


e 


(37) 


where k = l//y. 

Equation (37) is equivalent to equation (14) and equation (36) is 
equivalent to equation (15). The procedure for solving this problem by 
linear programming has been given in the preceding section. A typical optimal 
control policy obtained by Sakawa [2] is shown in Fig. 2. 

B. Single Heat Exchanger Without Wall Heat Capacity 

Huang, Fan and Hwang [5] determined the optimal control of a simple 
plug flow tubular heat exchanger by using the linear programming approach. 

A graphical representation of the system considered by them Is similar to 
that shown in Fig. 3. The process is described by the equation 


- K[0(t) - T(x, t)] (38) 

where T(x, t) is the fluid temperature distribution inside the heat exchanger 
and la dependant on the apace coordinate x(0 _< x <_ 1) end time t(0 < t < T), 
8(t) is the tube wall temperature which is uniform along the space coordinate 
and is treated as a control variable, and K is a constant heat transfer 


coefficient. 


The initial and boundary conditions are given by 


T(x, 

0) - 0 

(39) 

T(J, 

t) - 0 

(40) 


The performance index is defined as the absolute deviation from the desired 
temperature profile at the final time t^. 


S 


1 

5 

0 


T d (x) - T(x, t f ) | dx 


(41) 


where T^(x) is the desired temperature profile. 

This differential system is solved by the Laplace transform. The 
resulting integral representation is 


T(x, t) * K / e -K ^ t ""^e(£)d£, x >_ t 

T(x, t) - K f t e‘ K(t ‘ 5) eU)dC, x < t 
t-x “ 


(42) 


Equation (42) is equivalent to equation (14), and equation (41) is equivalent 
to equation (15). A typical result obtained by Huang et al. [5] is shown 
in Fig. 4. 

C. Tubular Heat Exchanger with Internal Heat Generation 

Huang and Yang [6, 7] solved an optimal control problem associated with 
a tubular heat exchanger with internal heat generation by the linear programming 
approach [see Fig. 3]. The system consists of a circular tube of length L 
through which a fluid flows steadily. Heat la generated In the tube wall. 

The process is described by the following equations. 
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i 


c 


where 0(x, t) and T(x, t) are the wall and fluid temperature, respectively, 

( t> is the rate of heat generation in the unit volume of tube wall and 
is treated as the control variable, p is the density, c^ is the specific 
heat, K is the ratio of surface conductance to heat capacity, t is the time, 

u is the fluid velocity, and x is the axial distance measured from the inlet. 

The physical properties of the tube wall are distinguished from those of the 
fluid by the subscript w. The initial and boundary conditions ure 

T(0, t, $) - 0 

T(x, 0, <p) - 0 (44) 

e(x, o, <t>) - o 


The performance index is defined as the absolute deviation from the desired 
temperature profile at the final time t^, i.e. 


1 „ T <*> 
I {|1 - 




T*(x) 


u - 


6(x, t f , *) 

7 * 00 " 


-] 


| > d( i) 
T*(x) 1 V 


(45) 


where T*(x) and 6*(x) are the desired fluid and wall temperature distribution, 
respectively. 

The solution of the system equation, equation (43), which satisfies 
appropriate Initial and boundary conditions may bs obtained by using the 
Laplace transform. On applying the Laplace transform with respect to t, 
the partial differential equations are reduced to two ordinary differential 
equations of variable x. The general solutions of the ordinary differential 
equations are then fitted to the boundary conditions, and the final solutions 
are obtained by the application of the Inverse transformation as follows: 


I 
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T(x, t, 4>) 
T*(x) 


(M+l) 


Kx o 


_ M+l KCt-t) 

, Kt [J-« M |®d(K ( ) 


u 


M 


- 

±- e u Q ; Kt * x(Kt* - KO d(KO 


e(x, t, $) 
0*(x) 


- K(t”£) 

/ Kt 1=^ + e M 1 *^P- d(KO 


77 + KxT o J l M+l M(M-fl) 

' u 1 

Kx 


« / Kt * A(Kt* - KO ^ 


M(1 + *p) 


« 


d(KO 


(46) 


where 


M 


In equation (46), ♦ is a constant rate of internal heat generation per unit 
volume; s - 0 when l + £*>0;s«l when 1 and t* • t- J . Furthermore * 


and A can be written as 


w(0 


*/* 4 "V « lo u/ff.-<xu 


A(0 


i kc - kx) - t toT T x , . % 

^ / u - • M )• V 2 /t fr |d(KX) 


I is the Bessel function of first-kind, seroth-order, and c - t - C. 

Equation (46) is approximately the seme as equation (14). Th« difference 
Is that equation (46) consists of two Integral equations while equation (14) 
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contains only one. Equation (45) is approximately the same as equation 
(15). Two absolute value functions are inside the integration sign of 
equation (45). Each absolute function should be defined separately as 
in equation (20). Figure 5 shows a typical control policy obtained by 
Huang and Yang [6, 7]. 

SUMMARY 

Although linear programming is a powerful technique for determining 
the optimal terminal control of the linear distributed parameter system, 
literature on this subject is fairly meager. Sakawa [2] appears to be the 
first one to apply the linear programming method to the terminal control 
of the linear distributed parameter system. He used Simpson's rule to 
transform the Integral solution into a linear combination of control functions 
which were evaluated at equally spaced sample points. For the case of a 
highly discontinuous control function, e.g., bang-bang type, this approxi- 
mation may give rise to a serious error. Use of an approximation which 
employs a piecewise constant control function may be able to circumvent this 
difficulty. 

Lesser and Lapldus [3] solved a time optimal control problem of a high 
dimensional Imped parameter system by linear programming. It appears that 
this scheme can ba modified for solving the optimal terminal control problem 
of complex linear distributed systems. 
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[35] ditcretizes the temperature profile of the element 
and considers the variation of physical parameters, but 
the regional variations are not included in the model. 

Although the physiological thermal regulation has 
been recognized for sonic time as an important factor 
in the human thermal system, the mathematical de- 
scription of this phenomenon is still not satisfactory. 
The model developed by Crosbie et at, f 1 1 ] uses the 
geometry of an infinite slab rather than a scries of con- 
centric cylinders, and builds in the function of physio- 
logical thermal regulation by allowing the effective 
thermal conductivity, metabolic rate, and rate of 
vaporization to vary as a function of the weighted mean 
temperature of the body. The model, however, does not 
include the effect of regional variations in heat genera- 
tion rates and blood flow rates. 

A physiological thermal regulator has been developed 
by Stolwijk and Hardy [27]. The model, however, does 
not consider the countercurrent heat exchange between 
large arteries and veins. A mathematical model of 
physiological thermoregulation developed recently by 
Stolwijk and Cunningham [26] can consider high met- 
abolic rates. Future human thermal models probably 
should include both regional variations of the physio- 
logical parameters and physiological thermoregulation 
of each element. 

The slab geometry was also utilized by Buchberg and 
Harrah [6] in establishing the relationship between the 
temperature of coolant in tubes and the mean skin 
temperature. Their model, however, does not consider 
the heat transfer by the blood circulation, regional varia- 
tions in heat generation rates, and blood flow rates. 

To utilize physiological information available in open 
literature [l ]-[$], [10], [12], [13], [16], [19], [24] 
and to combine Wissler’s model [31 ] with Stolwijk and 
Hardy’s [27] model of the physiological thermoregula- 
tion, it is very desirable to provide an improved model 
for the human thermal system. Such a model should 
consider the effects of regional variation of physiological 
parameters and the physiological thermoregulation of 
each element. This new model would adopt Buchberg 
and Harrah v s [6] conduction cooling to investigate the 
responses of the human thermal system to an external 
control device such as the space suit. The primary pur- 
pose of the external thermal regulation device is to keep 
the human body in thermal comfort [21 ], [22] by satis- 
fying the requirement of thermoneutrality. 

Nomenclature 

A Body surface area. 

A 9 Effective area of the exchanger. 

A e Effective area of the body creating convec- 
tion losses. 

Ac Effective area of the body creating evapora- 
tion losses. 


A r Effective radiation area. 

a, b Factors which eigh the contributions to the 
rate of change of body heat content by the 
increment of the rectal temperature and by 
the increment of the skin temperature re- 
spectively [in (10)]. 

di Radius of the ith element. 

C Rate of heat exchange with the environment 
by convection. 

Cjcc Thermal capacitance of the core of the 
extremities. 

Ceb Thermal capacitance of the skin of the 
extremities. 

Chc Thermal capacitance of the core of the head. 

Chb Thermal capacitance of the skin of the head. 

C p Specific heat. 

CgTc Thermal capacitance of the core of the 
torso. 

Ctm Thermal capacitance of the muscles of the 
torso. 

Ctb Thermal capacitance of the skin of the torso. 

D Rate of change of body I eat content. 

D x Diameter of the cylinder. 

E Rate of heat exchange with the environment 
by evaporation. 

E 9 Evaporative heat loss. 

E 9 tc Respiratory water vapor loss of the core of 
the torso. 

Ecn Respiratory heat loss assigned to the core of 
the head. 

EX Exercise (kcal/m*/h). 

F{ Wetted fraction of the surface. 

/« Effective contact area factor, dimensionless. 

H Effective heat loss assigned to the core of 
the head. 

H„ Heat transfer coefficient for direct transfer 
between the large arteries and veins. 

Hi Effective heat transfer coefficient at the 
surface of the ith element. 

H 9 Heat transfer coefficient for convection. 

He Heat transfer coefficient for evaporation. 

H r Heat transfer coefficient for radiation. 

A Heat transfer coefficient (skin to air) also 
known as surface conductance. 

k*i Proportionality constant of heat transfer 
between the arteries and tissue per unit 
volume. 

A* Rate of heat transfer from blood to tissue. 

Am Rate of tissue heat generation by metabolic 
reactions. 

A,< Proportionality constant of heat transfer : 
tween the veins and tissue per unit volume. 

K Thermal conductivity. 

K\ Universal radiation constant ~ 4.92 X10' 1 
cal/m # /h. 

K g Coefficient, heat exchange by convection. 
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A' Pi Mass transfer coefficient for passive diffusion 
of water through the epidermis. 

At ec fs Thermal conductance l>etween the core of 
the extremities and the skin of the extremi- 
ties. 

A , Coefficient of heat exchange by eva]x>ration. 

AY Evaporation conductance in (20). 

K f Thermal conductivity of the fluid. 

Afp Thermal conductivity in functional pe- 
riphery zone (Btu/h-ft °F). 

Ahciis Thermal conductance l>etween the core and 
skin of the head. 

A/ Mass transfer coefficient for convection. 

Kq 1.1X10“* cal/(cm s°C)=0.4 kcal/m/h/°C. 

K r Coefficient of heat exchange by radiation. 

Kr Approximate radiation conductance con- 
stant. 

A t Thermal conductivity of the tube. 

Atctm Thermal conductance between the muscle 
and the core of the torso. 

Atmts Thermal conductance between the muscle 
and the skin of the torso. 

L % Length of the ith element. 

11 Length of ttilie, ft. 

M Metallic rate. 

M ' Metallic rate per unit volume. 

A/o Basal metabolism. 

Af*/ Mass of the blood contained in the arterial 
pool of the ith element. 

Afoes Basal metabolism in the skin of the extremi- 
ties. 

Afore Basal metabolism assigned to the core of the 
torso. 

AfoTM Basal metabolism of the muscle of the torso. 

A/ohc Basal metabolism heat production assigned 
to the core of the head. 

Af ohs Basal metabolic rate of the skin of the head. 

Af*/ Mass of the blood contained hi the venous 
pool of the tth element. 

m Mass flow rate (lb/h). 

N Sweat loss (kg/m). 

n Slope of the curve which represents the 
relationship between 7Y and T f . 

( dp/dT)i Rate of change of partial pressure of water 
with temperature 7Y 

Q Volumetric blood flow rate (m*/h). 

Product of the mass flow rate and the specific 
heat for blood entering the arterial pool of 
the ith element from the adjacent mth ele- 
ment. 

Qt P Internal heat generation per unit volume in 
functional periphery zone (Btu/h’ft*). 

Q f The rate of heat loss through the respiratory 
system. 

Q 9i Product of the mass flow rate and the spe- 
cific heat for venous blood flowing into the 
venous pool of the ith element from the 
adjacent *th element 


i 


q Heat flux ( Btu/li). 
q t Heat loss by convection, 
ql Product of the muss flow rate and specific heat 
of blood entering the eapillarv beds pet unit 
volume. 

</«.» Product of the mass flow rate and spec'ln 
heat for arterial blond flowing into the * apil 
larics. 

</ cv Product of the mass flow rate and specifa 
heat for venous blood flowing into the pul- 
monary capillaries. 
q t Heat loss by evaporation. 
q r Heat loss by radiation. 
q rr Rate at which heat is transferred from ve- 
nous blood in the thorax to air in the respiar- 
tory system. 

q t Total heat loss from the body (keal/h). 

R Rate of heat exchange with environment bv 
radiation. 

R' Heat loss due to radiation and convection 
effect per unit volume. 

Rk Relative humidity of the ambient air 
t Radial distance front axis of < ylinder 
r f Latent Imaf lor evaporation (loal/kg) 

•V < oiidtH lion shape factor, tllmeimionlej* 

T Tissue tenif>rniUire. 

T\ Temperature of middle layer, 
r, Temperature of core layer. 

T a Temperature of blood in artery. 

7Y Temperature of the arterial blood entering 
the capillary bed. 

Temperature of the blood entering the arte- 
rial pool from the mth element. 

7», Temperature at the axis. 

Tb Average body temperature. 

7cb Temperature of the central blood compart- 
ment. 

r. Effective environmental temperature. 

Tec Temperature of the core of the extremities. 
7^ New equilibrium skin temperature defined 
in (12). 

7m Temperature of the skin of the extremities. 
T b« Arterial blood temperature at the heart. 

Tho Temperature of the core of the head. 

7h 8 Temperature of the head skin. 

7\,w Venous blood temperature flowing into heart 
from ith element. 

T in Inlet coolant temperature. 

7* Initial skin temperature. 

7V Internal temperature (core temperature). 
A7V Increment of the rectal temperature. 

T$ Mean skin temperature. 

Increment of the skin temperature. 

T, Mean radiation absolute temperature of the 
body surface in (13). 

T-i Mean contac t surface temperature °l\ 
r #j Skin temperature at time J. 

T, Temperature of blond in vein. 
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Win mis 1 >l< m j< I trmjHT.itun: in t lie nth dc- 

mrlll. 

Mr.m nuliaiil IrinpriaHin' of surround in^H. 
Mo, in r.idiiinl absolute imipiTatiin* of the 
mu H.imdiiiK wall. 
t'Vn.ill Iir.it traiisirr < orlin irill. 

U.iir 1 1 | lira I uxilian^i* by m*piralion. 
Voliimrtrir blood How raw in the cat >i 1 1 ary 
hnt 

Wl<«ily of the fluid whidi approaches the 
c> lindor (cm/s). 

1 1 **a l loss due to evaporation per unit area, 
l*,„ = 7 kcal/mVh. 

Heat loss due to evaporation per unit vol- 
ume. 

Partial pressure of moisture in the air 
( « percent RH X VP at T„). 

Partial pressure of water at temperature 7V 
Velocity of surrounding air (cm/s). 

Velocity of surrounding air (ft/min). 

Body weight. 

Distance from the surface of skin. 

Distance from the center of the tube to the 
end of the contact surface of the tidie, 

I hit knew ol coir lavri , 

I hit lutcM of mil lm e lavri . 

i(A.Y,+A.Yi). 

HAXi+AXt). 

Sum of the thickness of the skin zone and 
the functional periphery zone. 
Countercurrent factor of the core of the ex- 
tremities. 

Dimensionless fraction accounting for the 
effect of countercurrent heat exchange of the 
core of the head. 

Factor for countercurrent heat exchange of 
the skin of the head. 

Thermal conductivity coefficient of propor- 
tional control for (ATb> 0) -0.147/°C in 

(30) . 

Thermal conductivity coefficient of propor- 
tional control for (A7 b< 0) -0.066/°C in 

(31) . 

Metabolic rate coefficient of proportional 
control; AT* <0. 

Countercurrent factor of the core of the 
torso (63). 

Countercurrent factor of the muscles of the 
torso (64). 

Countercurrent factor of the skin of the 
torso (65). 

Evaporation coefficient of proportional con- 
trol *11 kcal/mVh/°C; A7*>0. 

Latent heat of water at 7Y 
Evaporation coefficient of fourth power pro- 
portional control 53 kcal/mVh/^C; ATa>0. 
Density of blood. 

Density (kg/m 1 ). ’ 


y k Thermal conductivity coefficient of rate 
control (s/°(' / >^3.5 s/°C). 

&kx Increase in evaporation coefficient due to 
violent exercise. 

M Viscosity of the fluid. 
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Steady-state simulations o r the human 
thermal system with and without an external ther- 
mal regulation device are can led out. The 
mathematical model of the human thermal system 
without the external thermal regulation device is 
essentially the model by Wissler. The model with 
the regulation device is obtained by modifying 
Wissler' s model. The thermal regulation device 
is controlled in such a way that the requirements 
of the thermoneutrality of the human body under 
the specific environmental condition and specific 
body activity are satisfied. The effects of 
localized control of the external thermal regu- 
lation device on the totality of the human ther- 
mal system are examined. The results indicate 
that the thermoneutrality of the human body can 
be attained through the partial cooling or 
warming of the body. 

The geometry on which the human thermal 
system is based consists of a number of cylin- 
drical elements representing the head, torso, 
arms, and legs. In each element, the large 
arteries and veins are approximated by an 
arterial pool and a venous pool. The heat trans- 
fer from the tissue to the surface of the skin 
and the heat transfer by bulk flow of blood 
between adjacent elements are taken into account. 
Axial thermal gradient in every element is 
neglected. A model based on this description of 
the human thermal system is simulated on a digi- 
tal computer under a variety of external con- 
ditions . 

The external thermal regulation device con- 
sisting of a network of tubes which are held in 
contact with the surface of the skin is for 
removing metabolic heat generated in the body. 

The operating or control variables of the exter- 
nal thermal regulation device are the inlet 
coolant temperature and its flow rate. A model 
of the integrated system is f> 'Tnulated by in- 
corporating the mathematical model of the exter- 
nal thermal regulation device into the mathe- 
matical model of the human thermal system. 

Steady-state computer simulations of the 
Integrated system are carried out and the tem- 
perature distributions of the human body are 
determined for a variety of the inlet coolant 
temperatures and coolant flow rate combinations. 
The effects of localized cooling or warming of 
head as well as head and torso for various body 
metabolic rates are also examined. The vari- 
ations of physiological parameters, such as ths 
local blood flow rate and local metabolic rate, 
in the muscle layer and skin layer are con- 
sidered. In addition, the regional variations 
in the blood flow rate, metabolic rate, and rate 
of vaporization are considered. 


In carrying out the simulations on a digital 
computer, the finite difference techniques are 
used to approximate the models which consist of 
partial differential equations. Two typical 
simulation results of the model with the regu- 
lation device are shown in Figures 1 and 2. 

Figure 1 shows the temperature profiles in 
various elements of a human body under the spe- 
cific condition in which the head is being cooied 
by a hood with specified coolant temperature of 
40.0°F and flow rate of 250 lbs/hr while the 
other elements are exposed to the effective 
environmental temperature of 107. 6°F (42,0°C). 

The results indicate that proper cooling of the 
head will adequately control the temperature at 
other parts of the body. Figure 2 shows the 
effect of the liquid coolant temperature on 
cooling of the human body which wears a cooling 
hood and jacket while arms and legs are insulated 
from their hostile environment. The results In- 
dicate that a comfortable brain temperature of 
98.0°F (36.7°(n can be achieved by a number of 
combinations between the liquid coolant tem- 
perature and its flow rate. 

Acknowledgement. This work has been 
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Fig. 1, Steady-state temperature profiles of 
the human body with cooling hood 
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Unsteady-state simulations of the human 
thermal system with ard without an external ther- 
mal regulation device are carried out. The math- 
ematical model of the human thermal system 
without the extet tal thermal regulation device is 
essentially the imdid by Wissler. The model with 
the regulation device is obtained by modifying 
Wissler's model. The thermal regulation device 
is controlled in such a way that the requirements 
of the thermoneutrality of the human body at any 
moment during the transient period are satisfied. 
The effects of localized control of the external 
thermal regulation device on the totality of the 
human thermal system are examined. The results 
indicate that the thermoneutrality of the human 
body can be attained through the partial cooling 
or warming of the body. 

The geometry on which the human thermal 
system is based consists of a number of cylin- 
drical elements representing the head, torso, 
8rms, and legs. In each element, the large 
arteries and veins are approximated by an 
arterial pool and a venous pool. The heat trans- 
fer from the tissue to the surface of the skin 
and the heat transfer by bulk flow of blood 
between adjacent elements are taken into account. 
Axial thermal gradient in every element is 
neglected. An unsteady-state model based on this 
description of the human thermal system is simu- 
lated on a digital compute’: under a variety of 
external conditions. 

The external thermal regulation device con- 
sisting of a network of tubes which are held in 
contact with the surface of the skin is for re- 
moving metabolic heat generated in the body. 

The operating or control variables of the exter- 
nal thermal regulation device are the inlet 
coolant temperature and its flow rate. An 
unsteady-state model of the integrated system is 
formulated by incorporating the mathematical 
model of the external thermal regulation device 
into the mathematical model of the human thermal 
system. 

Unsteady-state computer simulations of th« 
integrated system are carried out and tha tem- 
perature distributions of the human body at any 
given time are determined for a variety of the 
inlet coolant temperatures and coolant flow rata 
combinations. The effects of localised cooling 
or warming of head aa well aa head and torso for 
various body metabolic rates are also examined. 
The variations of physiological parameters, such 
aa the local blood flow rate and local metabolic 
rate, In the muscle layer and akin layer are con- 
sidered. In addition, the regional variations In 
tha blood flow rate, metabolic rata, and rite of 
vaporisation ara considarad. 


In carrying uut the simulations on a digital 
computer, the finite difference techniques are 
used to approximate the models which consist of 
partial differential equations. Two typical 
simulation results of the model with the regu- 
lation device are shown in Figures 1 and 2. 

Figure 1 shows the change of core temperatures of 
various elements during two hours simulation time. 
A human subject in this simulation is exposed to 
an effective environmental temperature of 
107. 6°F. (42.0°C) except head which is being 
cooled by a hood with coolant temperature of 
60,0*F. and flow rate of 250 lbs/Hr. The results 
indicate that the human subject will reach its 
uncomfortable state within on* and a half hours 
because the core temperature (rectal temperature) 
of torso will increase more than 2,0°F. These 
results are compared favorably with the experi- 
mental data. Figure 2 shows the temperature 
profiles of torso at various simulation time. A 
human subject in this simulation wears a cooling 
hood and jacket while arms and legs are Insulated 
from their hostile environment. The results in- 
dicate that if the constant thermal comfort is 
to be maintained, the operating variables have 
to be controlled properly. 
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ABSTRACT 


< 
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4 


A mathematical model of the human thermal system under steady state 
conditions is formulated by using six cylindrical elements representing 
longitudinal segments of the head, torso, arms, and legs to approximate 
the human body* The model allows the use of different physiological 
parameters such as local rate of metabolic heat generation and local blood 
flow rate in various locations of an element. The regional variations of 
the physiological parameters are also taken into consideration. 

A set of ordinary differential equations representing the thermal 
behavior of all elements are approximated by a set of algebraic equations 
which resulted from the application of the explicit forward finite difference 
method. Specifically twenty-eight linear algebraic simultaneous equations 
are obtained by using five grid points in the spacial coordinate of each 
element. The model : , imulated for a number of steady state environmental 

condi t ions . 
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1. INTRODUCTION 

Due to the difficulties of predicting the human thermal responses of 
persons who are ofcen exposed to the hostile environment of industrial and 
mining plants such as chemical, atomic and metal plants and coal mines, and 
of persons who are involved in underwater or space exploration, a need 
exists for a mathematical model which will provide a method for predicting 
the human thermal responses i nder a variety of environmental conditions. 

A need also exists for a ro ithematica.l model which will provide a method for 
estimating the physiological parameters such as the local blood flow rate 
and the local rate of heat generation by metabolic reactions which are often 
difficult to obtain by direct experimental measurement Although many 
early models were developed for the purpose of describing the physiological 
phenomenon, the quantity ive description of the intracorporeal transport 
of heat by circulating blood, which has been recognized for sometime as an 
important factor in thermal physiology, is still unsatisfactory [ 9 , 16 ]. 

The purpose of this report is to present a mathematical model of the 
human thermal system and results of simulation of its thermal responses to 
a specific environmental condition under steady state conditions. The model 
describes quantitatively the physiological phenomenon of heat transfer inside 
the human body and heat transfer between the human body and its environment. 
The model is capable of predicting the temperature distribution in the 
various elements of the body. The simulation of the mathematical model can 
be advantageous employed to verify the goodness of the model. It also 
enables one to replicate the experiments, to study control scheme, and to 
invejtigate the system sensitivity and stability. [ 15 , 19 ] 
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Permes [12] (1948) has demonstrated the utility of a mathematical model 
by comparing measured and computed temperature profiles in the human forearm. 
Although the discrepancies of the temperature profiles in the vicinity of 
large arteries and veins are sizable, his model has been considered as a 
tore satisfactory description of the human body than the "core and shell" 
concept which has often been used by early researchers. The models developed 
by Eichna, Ashe, Bean, and Shelly [3] (1945) and by Machle and Hatch [11] 

(1947) are based on the concept of "core and shell" in which the rectal 
temperature and mean skin temperature are used as measures of the core and 
shell temperatures, respectively. These models fail in many cases because 
the amount of build-in information is relatively small and the effects of 
peripheral circulation is not considered explicitly. 

Wyndham and Atkins’ model [20] (1960) approximates the structure of 
the human body by a series of concentric cylinders. The effects of periph- 
eral circulation are considered implicitly by allowing the effective thermal 
conductivity to vary as a function of temperature but the regional variations 
of physiological parameters are not considered. The model by Crosbie, Hardy, 
and Fessenden c 2] (1961) uses the concept of infinite slab rather than a 
cylinder. Many important physiological responses to thermal stress are 
considered in their model by allowing the effective thermal conductivity, 
metabolic rate and rate of vaporization to vary as the mean temperature of 
the body varies. However, the effect of regional variations in heat generation 
rates and blood flow rates are excluded. 

The earliest model developed by Wisslet [17] (1961) is an extension of 
Pennes 1 work [12] (1948). The steady-state temperature distribution in the 
human body can be obtained [17] when the environmental conditions, the dis- 
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tribution of metabolic heat generation, the distribution of blood flow, and 
the size of the body are specified. One of Wissler's models [18] (1963), 
which is a modi ii cation of W\ ndham and Atkins* model, can be used to obtain 
the transient-s tate temperature distribution of the human body. A review 
of the mathematical models of the human thermal systems has been presented 
[4] (1970). 

Ttv- mathematical model presented in this report is based on one of 
Wissler's models [19] (1964). The present model considers the local 
variations of the ef f ective thermal conductivity, metabolic rate, and rate 
of vaporization. The regional variations of physiological parameters are 
also taken into account. 

The formulation of the mathematical model and the finite difference 
approximation of the system equations of the model are presented in con- 
siderable detail in this report. The results of steady state simulation 
of an experiment in which a hypothetical human subject is exposed to a 
specified environmental condition are also included. The environmental 
condition specified is that a nude human body is exposed to an effective 
environmental temperature of 107. 6°F (42.0°C.) except the head which is 
exposed to a lower effective environmental temperature of 77.0°F. (25.0°C). 


n 







formulation of the mathematical model 

A mathematical model v;hich represents the steady-state condition of 
die human therr.ial system is formulated in this section. The model is based 
on one of Wissler’s models [19] (1964) which is for the unsteady-state con- 
ditions. The present model differs slightly from that of Wissler’s in the 
expression of thermal energy balance equations of the torso. The present mode] 
assumes the existence of an arterial pool and a venous pool in the torso and 
considers the heat exchange of the torso with adjacent elements only through 
the pools. Wissler’s model considers the heat exchange of the torso with 
adjacent elements throigh pulmonary capillaries. 

2.1 Description and Mathematical Expression 

The mathematical model of the human thermal system formulated in this 
report considers the following important factors: (1) local generation of 
heat by metabolic reactions, (2) conduction of heat due to thermal gradients, 
(3) convection of heat by circulating blood, (4) the geometry of the human 
body, (5) the existence of an insulating layer of fat and skin, (6) counter- 
current heat exchange between adjacent large arteries and veins, (7) sweating, 
and (8) the condition of the environment, including its temperature, wind 
velocity, and relati /e humidity. 

The geometry of the human body on which the system equations are based 
is shown in Fig. 1. It consists of a number of cylindrical elements 
representing arms, legs, torso, and head. Each element, consisting of tissue, 
fat and skin, has a vascular system which can be divided into three sub- 
systems representing the arteries, the veins, and the capillaries. 
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M •»- ], .‘i -hich is generated in an element by metabolic reactions is 
stn' enent, carried avav bv circulating blood to other elements 

(r co the surface where it is generally transferee! to the environment. 

Lf • v -i' environmental temperature is higher than the skin temperature, the 
direction of heat flow is reversed. Based on the first law of thermodynamics 
the phenomenon can be expressed mathematically as the differential heat 
balance equation for the ith element as follows: 


r dr 


dT. 

(K. r t~) +h.+q.(T.-T.) 
i dr tp l ci ai i 


+ h . (T . - T.) + h . (T . - T.) 

ai ai l vr vi i 


= 0 

where 

l\(r) = temperature of the tissue, bone, fat, or skin 
at a distance r from the axis of the ith ele- 
ment, 

K^(r) = thermal conductivity of tissue, bone, fat, or 
skin, 

*\ni = meta b°li c heat generation per unit volume, 

q ci = product of the mass flow rate and specific heat 

of blood entering the capillary beds per unit 
volume, 

^ai “ P ro P ort i° na lity constant of heat transfer between 
the arteries and tissue per unit volume, 

h - proportionality constant of heat transfer between 
the veins and tissue per unit volume, 

T - temperature of the arterial blood, 
a i 


(i) 


/ 

* 
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T . - temperature of the venous bJood 

vi 

The terms on the Left-hand side cf equation (J) represent the net rate of 
heat conduction into the unit voLume, the rate of heat generation by 
metabolic reactions in the unit volume, the net rate at which heat is carried 
into the unit voLume by the bulk flow of blood, the rate at which heat is 
transfered into the unit volume from arterial blood, and the rate rt which 
heat is transfered into the unit voLume from venous blood. 

The longitad ; nal effect of heat conduction is neglected in equation (1) . 
Pennes [12] (1948) has shown that the longitudinal heat conduction is 
negligible in arms. This is probably also true in legs because their shape 
is similar to that of the arms, but it might not be true in the head and 
torso. Hence the future human thermal model probably should include the 
effect of long tudinal heat conduction in the head and torso. 

An assumption that the temperature of blood leaving the capillary beds 
is equal to the temperature of the neighboring tissue is also made. This 
assumption is acceptable because the capillary has very small diameter 
which ranges ;rom lOy to 20p [17]. Such a condition does not prevail in 
the large arteries and veins. Therefore, it is necessary to assume that 
the rate of heat transfer from the blood in the larger vessels to the 
neighboring tissue is proportional to the temperature difference between 
the blood and tissue. The proportionality constant is expressed by h 

ax 

for the arteries and h . for the veins in the ith element. 

vi 

It is renown that the human blood temperature in the various locations 
of the body are different [6, 8, 10]. Therefore, two additional equations 
which represent the overall thermal energy balances in arteries and veins 
are required. Tn deriving such equations it is assumed that the blood in 
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the* large arteries and veins *a *ae ith element ha.-, uniform temperatures 
and respectively as shown in Fig. 2. Jlu* resulting equations are 


ai 


am 


T .) + 2;iL. 
a 1 l 


a . 

r 1 

0 


i . a 

a j j. 


T .) r dr 
ai 


+ H . 
avL 


(I 


vi 


T ai> 


( 2 ) 


= 0 


(T - T .) + 2r.L, 


VI 


a. 
. i 


(q . + h , ) (T. - T . ) 
Cl VI 1 vi 


r dr 


+ li (T . - 
a vi ai. 


T .) 
vi 


(3) 



= 0 

where 

Q . = product of the mass flow rate and s 4 ecific heat for 

ai 

blood entering the large arteries of the ith element 
from the mth element, 

T (t) = temperature of the blood entering the large arteries of the 
am 

ith element from the mth element, 

= length of the ith element, 

- radius of the ith element 

H £ = proportionality constant of direct heat transfer 

between large arteries and veins, 

Q v ^ = product of the mass flow rate and specific 
heat for venous blood entering the large 
veins of the ith element from the nth element, 

J v n ( t ) = temperature of the blood entering the large 

veins of the ith element from the nth element. 
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The terms on the left-hand tide o r equation (2) represent, in order the 
rate at which heat is carried mt<' the large arteries in the ith element 
by the bulk flnw of blood from the adjacent element, the rate at which 
heat is transferred into the blood in the large arteries of the element 
from neighboring tissue, and the rate at which heat is transferred directly 
from f he large veins to the ~arge arteries. 

liquation (3) which is for the venous blood contains the cc •■responding 
terms. The only difference between equations (2) and (3) appears in the 
second term. This difference appears as an additional expression 


2ttL 

x 



(T. - T .) r dr 
1 vi 


in the second term of equation (3). This expression corresponds to the 
rate at which heat is carried into the large veins in the ith element from 
the capillary bed by flowing blood. The integral appears in equations (2) 
and (3) because the tissue temperature, T (r), is a function of r. The rate 
of blood flowing into an element is assumed to be equal to the rate of 
blood flowing out of the element. 

2.2 Boundary Conditions 

The boundary condition which represents the heat transfer from the 
sunace of the skin to its environment takes the following form. 


-IK, 


fi, 

dr 


r=a. 


VW - T .i> 


( 4 ) 
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wh>* re 

H. = heat transfer coefficient at the surface of the 

i 

ith element (gee Appendix A) 

T = effective environmenta 1 temperature at the surface 
ei 

of the ith element 

Equation (4) states that at the surface of the skin the local rate of 
heat conduction to the surface through the tissue is equal to the rate 
of heat transfer from the surface to the environment. 

Due to the axial symmetry of each element the following condition 
also exists 


dT i 

<dT> 


r=0 


0 


( 5 ) 
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3. FINITE DIFFERENCE APFROX'MAI in\ OF the MODE! 

The finite-difference technique which is employed in this section 
enables one to consider the varimion of physiological properties at various 
positions of the body. According to this technique the independent variables 
are discretized. More specifically, each of the cylindrical elements is 
divided into a series of concentric cylinders and appropriate values are 
assigned to the physiological parameters of each element. One of the advan- 
tages of the finite difference technique is that one can use a smaller 
segment of the radial distance near the surface of the element where the 
temperature profile has steeper gradient and a larger segment can be 
used in an inner core where the temperature profile is nearly flat. 


3.1 Finite Difference Scheme 

The explicit forward finite difference technique is employed to approximate 

equation (1). [1, 5] The general expression of the forward finite difference 

technique can be written as 

dT(x) _ T (x+Ax) - T(x) 
dx Ax 


Each term in equation (1) can be integrated from r = r ^ - (A5, /2) to 
r = r_. + (AH + /2) where A£_ represents the space increment to the left of 
r^ and A£ + represents the space increment to the right of r ^ . 


A ?+ 

r j ~~ 


Ll m 

'.I ' ” 


f 


dT i 

d(K i r dT> + 


. j. f h rdr 
A£ mi- 


r j ‘ 2 


r j 2 


h .rdr + 
ral+ 


r, - 


A£_ / 
~ 


[<< 1 cl- +h .l- )(T ai ' T f > + \l- (T vl - V> 
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+ / 


r . 
J 


r . 
3 


Uq + h ,,)(T . 
vi+ ai-’- ai 


T.) + h (T . 
1 va+ v 


- T . ) ] rdr 
i 


= 0 


Tlio finite difference* approximation of the equation becomes 


A'. T. . . , , s -T. . 


1 * t *_i_ i \ l • • a?. T . . — T , . , _ * 

c (T + _±) _jjj±L) n _ K (r ju id:. 1 ) 

K i+ (r j + 2 ' Li + V U j 2 > 




A£ A V A?. A?, 

+ ( -f- (r. - -,-)h . + (r. + —r— )h } 

2 j 4 mi- 2 j 4 mi+ 


Av! Av, 

+ 1 -f <r j - + h »i-> (T ai - V - h vi- (T vi - V 1 


A it A 3c 

+ — (r + — t—) [ (q . . + h ) (T . - T 44 ) + h . . (T . - T ) ] } 
2 j 4 n ci+ ai+ ai ij vi+ vi ij 


= 0 


( 6 ) 


where T represents the tissue temperature of the ith element at the jth 
radial point. The quantity with the negative subscript (-) represents the 
physiological parameters at the left of r^ whereas the positive subscript (+) 


represents the same properties at the right of r 


j 


Let 


AI 563 2 ^ r j * 4 ) 


M Ail 

A2 * ~2~ (r^ + — ) 


•***«*& p r « r ' * * mnr-T+.r*G*»* <r * 


A, = K. + U-. - 


.U 

k4 = K . (r 7 -) 

1 - j z 


A5 = q . 

^ c: 1 - 


4- h 


A6 = q . 4- h 

ci4* ai4- 


Ilien equation (6) can be written by 


A3 x 


_ A4 x T u “ T M j : i) 


AC 


+ IA1 x h„j. + A2 X li nl+ ( + (Al[A5(T al - T^) + h vl _<T vl - T (j )] 
+ A2[A6(T al -T ij ) + h vl+ (T vl -T lj )]} 


= 0 


(7) 


Equation (7) can be rearranged as 


T r^-1 + T [- — - 77 - - A1 x A5 x h - A2 x A6 

1 • ( j-1) l /U_ J i j 1 AH + AH_ vi- 


-A2 x h 1 + T . , . [^-1 + T . [A2 x A6 + A1 x A5] 

vi+ J i(j+l) A*. + J ai 


+ T.. 4 [Al x h vi + A2 x h vi J 


vi 


vi+ 


-( A1 x + A2 x h mi+ ] 


( 8 ) 


which can be further sirin' U a tn 


X . , , + V . . 1 . . + Z. T ..... . 4- A. . . . + V . . T , = C . . 

i] mi- 1 i] ii i' iCj + 1) ij ai ij vi i] 


A 3 A 4 


- Al x A 5 - Al x h . - A2 x A6 - A2 x h . 

vi- vi+ 


A. , = Al x A5 + A2 x A6 
U 


I ■ i c 


V, . = Al x u , + A2 x h . 

Li ;i- vi+ 


C. , 5 -Al x h . - A2 x h , t 

ij mi- iri+ 


It is worth mentioning that ^ f Y^, , and C are all functions 

of the physiological parameters and raesh size. The metabolic heat generations, 

h . and h . are considered only at certain iayers of the jody. Assumptions 
mi- mi+ 

have been made that heat generation by metabolic reactions in the layer of fat 
md skin is zero and that basal metabolism occurs only at the core layer. 

Any additional heat generated by metabolic reactions due to body exercise is 
considered to occur in the muscle layers. 


At the boundary where r * the integration of eqviation (1) from 
r * Tj - / 2) to r ■ Tj can be approximated by 


» 
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- ) 


r - T 
iJ i ( i- 1 ; 


Av 


+ - 7 - (r, - -r)[(n cl . ♦ (T„ - T tJ ) ♦ h vl .(T yl - T u )l 


- 0 


( 10 ) 


The boundary condition given in equation (4) employed to evaluate the 

1 *p 

value of [K. . (qp-) ] at r = r In equation (10). This yields 
1 + dr J 


- <r J> Vl.t - 'ei' - K i- ,r J - -f > 


T - T 
IJ 1 (J-l ) 


— KVj - T Mvs ci . ' ‘‘ai- /v ‘ai *U' ■ “vi- v ‘vi *U' 


+ — - (r ~) [ (q . + h . ) (T . - T . ,) + h (». ' r ' 1 

9 V 1 T A 7 1 v 1 1 _ a i - ' v ra V t - VI 


= 0 


or 


<'j) H i t T U - T el> - 81 * T ‘ J * B2 ' B3(T al * T 1J» 


h . (T . 
vi- vi 


- T ) 1 
iJ ; J 


- 0 


(ID 


where 


B1 


K i- <r j 



B2 



.3 


'cl- 


+ h 


ai- 


i&wim . . j 


V#’ - ' . .■/*/<- 
^ JF* * " *' '-■*** - ^ /4 f: 


Equation (li) can be rearranged as 


T i(J-l) «Sh + V' r J Hi - fl- - B2 X B3 - B2 X h^J 


+T ,tB* x B3] + T . [ B2 x h ] 


•i, A. T . 
J i ei 


It should be noted that the value of metabolic heat generation, h^, 
is assumed to be zero in equations (10) through (12) • This is due to the 
assumption that the layers of fat and skin do not generate heat by metabolic 


reactions. 


Equation (12) can be simplified as 


X iJ T i (J-l) + Y iJ T iJ + A iJ T ai + V iJ T vi 


where 


iJ At 


Y iJ " " r J H i ’ aT - 82 X 83 " 82 * h vi- 


A tJ - B2 x B3 


V - B2 x h 
U • vi- 


C U ’ " r J H i T «i 


lft 


Similarly, the finite difference approximation for equation (1) at the 
center of each cylindrical element can be obtained by integrating equation 


(1) from r = 0 to r 


2 ‘ 


T - T A* A* A Z M 

K i+ ^ 2 ) IT + *~T~ V ^ h mi+* + ~2~ ^ 4 ^ ^ q ci+ + h ai+* 


(T ai - T il> + h vi+ < T vi - T il> ] 


= 0 




or 


C1 * + C2 * *W + C2lC3 <V - T il> + h vl + (T vl ' T U>> 


(14) 


where 


A£ 

C1 " K i+ ( ~r ) 


n, a i. 

ca - -r <-r> 


03 " q ci+ + h ai+ 


Equation (14) can be rearranged as follows: 


I 


T il>-% - a « C3 - a X h rt+ ) ♦ T 12 [g-1 


♦ T #l tC2 X a) + T^tC2 x 


- - C2 X h 


«i+ 


(15) 
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Further simplification of equation (15) yields 


Y il T il + Z il T i2 + A il T ai + V il T vi “ C il 


where 


JT - C2 » C3 - C2 X 


'11 SI, 


A - C2 * C3 


V 11 • a * h vH- 


C 11 * X h «l+ 


The coefficients X 1Jt Y 1Jf A ±J , V^, and in equation (13) and the 
coefficients Y 1# Z^, A^, and in equation (16) are also functions 
of the physiological parameters and mesh size. 

By using Simpson's rule (14] to carry out the integration, equation (2) 
becomes 


0.1 < T « 


2,L t h tl T. t 


(*,) J . 

~t~ * U h h .l jJj C 1J T 1J 'j 


♦ H .vl (T vl - V 
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or 


Q .(I - T .) 

ai am ai 


nL l h ai T ai (a l> 2 + 2 ’ L i h .l * ml c y T ij 


+ H (T . - T .) 
avi vi ai 


(17) 


where 


l iJ 


"11 


J U 3(J-1) 


4 r 


iJ 


"12 


'14 


'i(J-l) 3(J-1) 


(18) 


2 r 


C 13 * C 15 


IJ 


'i(J-2) 3(J-1) 


In order to use a smaller mesh size for the special coordinate around 
the outer layers where the gradient of the temperature Is steeper than that 
in the inner part of the cylinder, equation (18) ia modified slightly and 

t 

the following values of are used in the coaputer program. 

The radius of the cylinder is divided into three equally spaced interval* , 
The outer third is then divided into two halves. The grid points are 
designated as r^ r 2> r 3 » r^, and r 5 « 

The values of can be given as follows: 

c n ■ h <r> 


'12 


A ( !i> 

3 l 3 9 


c « • i £> ♦ $ <£> 


***"* ^ijrjWtyjwr^'iia^ 


mm^^m»-v , r^*^'-'^ r> •*'*- *« "* - 
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f 4 i 

c i 4 * 3 ( r> 


t i 

C i5 * 3 ( 6~ ) 


Substituting the values of C into equation (17), one obtains 


Q ai (T a»' T ai ) - "Ljh^T^ (a ^ 2 + 2 , 1 .^, U 3 (y^l T^j 


3 3 3. 

+ I 3 (y)] T i2 r 2 + *3 + 3 T i 3 r 3 


+t 3 ( 6 )] T i4 r 4 + *3 ( 6 )J T i5 r 5 } + H avi (T vi" T ai ) 


= 0 


jr 


2lrL i h ai {t J ( 3 r l T il + *3 ( 3 r 2 T i2 


+ t 3 (3 ) J 3 ( fi )] r 3 T i3 x l 3 ( 6 >1 r 4 T i 4 


1 S 
ri / A 


+ >3 <r» r sV + I'V-Vai <*!>' - H .vll T .l 


+ H ,1 . + q .t 

a vi vi ai « 


This equation can be simplified as 





*^ x * ■'' f v V l! 


P 11 T H + P i2 T i2 + P i3 T 13 + P i4 T 14 + P i5 T i5 + A i6 T ai 


+ V,,T . + E.,T 
i6 vi i6 am 


where 


1 , a i. 


p i. ■ 2 " l , h .i [ 3 ( r ),r i 


P i? " 2lTL i h ai^3 ^3 ^ ^ r 2 


3 3 

P 13- 2 * L i h al [ i ( T' )+ l ( 6 i)lr 3 


P i4 " 2l,L l n al*3 ( 6 *' r 4 


*J V 

$ *r’ 

y I r 

t ; N f * 

4*-]r v 

J* ^ ■ 

fuH&s?-'-* ■ ■ 


P 15 ■ 2 ’ L i h .i<3 ( 6 i,lt 5 


A i6 = ~ Q ai “ "V'ai^l^ “ H avi 


V • H 
16 avi 


E iS " Q ai 


Equation (3) can be similarly approximated as 


W'V - 2 " L l (<l ci +h vi ) — T vl 


J .. 


♦ 2 "-iKl'*-,±> f ml C l) T 1J r J + ".Yl'^rV 


( 20 ) 
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The values of C can be given as 


ii i 

C il = 3 ( T } 


" A 

c,, = ^ Or-) 


"i2 3 3 


C i3 


I ( i )+ 1 ( i) 

3 '3 ; 3 '6 ; 


'i4 


A A, 

3 ^6 ’ 


» i i 

C,c - 4 (7 1 ) 


i 5 3 6 


Substituting the values of into equation ( 20 ) and rearranging the 


terns, one obtains 
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vn 


\ 
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This equation can be simplified as 


Q il T i] + Q i2 T i2 + Q i3 T i3 + Q i4 T i4 + Q i5 T i5 + A i7 T ai 


+ V, ,T . + E, _T 
i7 vi i7 vn 




where 


i , a i, 


«u - 2rt i<‘lcl +h vi >[ 3 <- )lr l 


2lTL i^ q ci +h vi^3 ^3 ^ r 2 


r 1 /lx . A A, 


27rL i ( q ci +h vi ) [ 3 ( r> + 3 ( r )]r 3 


4 ,V 


Q i4 " 2,rL i (q ci +h vi )l 3 ( 6- )lr 4 


1 ,®i, 


Q i5 " 27rL i (q ci +h vi )t 3 ( F )]r 5 


A i7 H avi 


V i7 " “Qvi " irL i (q ci +h vi )(a l ) “ H avi 


E i7 - Q vi 


The system equations, equations (1), (2), and (3), for the ith 




element can now be replaced by a set of linear algebraic simultaneous equations 
represented by equations (9), (13), (16), (19), and (21). In summary, 
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Y il T il + Z il X i2 


+ A il T ai + V il T vi = C il 


X i2 X il + Y i2 T i2 + Z i2 T i3 


+ A i2 T ai + V i2 T vi * C i2 


X i3 T i2 + Y i3 T i3 + Z i3 T i4 


+ A i3 T ai + V i3 T vl = C i3 


X i4 T i3 + Y i4 T i4 + Z i4 T i5 + A i4 T ai + V i4 T vi = C i4 


X i5 T i4 + Y i5 T i5 + A i5 X ai + V i5 T vi = C i5 


il T il + P i2 T i2 + P i3 T i3 + P i4 X i4 + P i5 X i5 + A i6 T ai + V i6 X vl * “ E 16 T am 


Q il X il + Q i2 X i2 + Q i3 T i3 + Q i4 T i4 + Q i5 T i5 + A i? T ai + V i7 X vi “ ' E i7 T vn 


4 ? i 

-h !! 

3 *; 

-5S f 
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3.2 Linear Algebraic Simultaneous Equations 

The number of difference equations obtained from the technique employed 
in this work depends on the number of grid point used to discretize the 
independent variable. A set of simultaneous linear algebraic equations 
included in equation (22) are obtained by using five grid points to dis- 
cretize the radial distance of the ith element. With seven simultaneous 
linear algebraic equations representing the thermal characteristics of each 
element, the total of twenty-eight simultaneous linear algebraic equations 
are required to represent the human thermal system. The synthesized system 
equations for the entire system are illustrated in Table 1. 

The first set of linear algebraic equations in the upper left hand 
comer represents the thermal characteristics of the head. The second, 
third, and fourth sets of linear algebraic equations from the upper left 
hand comer represent the thermal characteristics of the torso, arm, and leg, 
respectively. The interdependence between elements is represented by the 
terms scattered around the blocks of terms. The coefficient of these inter- 
connecting terms are the function of blood flow rate between the adjacent 
elements . 

Since the coefficients of all the terms appearing in Table 1 are functions 
of the physiological parameters and mesh size, the local and regional 
variations of the physiological parameters can be conveniently examined. 

The temperature distribution in each element for a given environmental 
condition can also be determined by solving these twenty-eight simultaneous 
linear algebraic equations. 
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The method of solving these equations is by eli rd. nation using the 
largest pivotal divisor [/]. Each stage of elimination consists of 
interchanging rows when necessary to avoid division by zero or small elements 
The computer program for thir method is conveniently provided by the IBM 
System/ 360 Scientific Subroutine Package under the subrouting name SIMQ. 
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4. SIMULATION OF THE MATHEMATICAL MODEL 

To test the validity of the mathematical model of the human thermal 
system, a number of simulations have been carried out and the results are 
described in this section. An experiment with a human subject is carried 
out in an environment in which the torso, arms, and legs are exposed to an 
effective environmental temperature of 107. 6®F (42.0°C) whereas the head is 
exposed to a cooler temperature of 77.0°F (25.0°C). This particular environment 
is selected in order to lay the ground work for future studies on the effects 
of localized cooling (or warming) on the entire human thermal system. The 
following types of simulations have been carried out and they are listed in 
the increasing order of complexity. 

(1) The blood flow rate between the adjacent elements and the local heat 
generation by metabolic reactions are assumed to be zero in the system. The 
assumption implies that a human body is disjointed into six independent elements 
namely, the head, torso, two arms, and two legs. 

(2) The disjointed Independent elements are connected by blood 
circulation between adjacent elements. The local rates of heat generation 
by metabolic reactions are, however, neglected. 

(3) The elements are all connected by blood circulation between 
adjacent elements. Each element is generating heat by metabolic reactions. 

These particular types of simulations are selected because one can obtain 
results which can be verified fairly easily. 

The purpose of the subsection Is to present the results of simulations 
and employ them to test the validity of the model. Table 2 summer lzes the 
numerical values of physical dimension of the human body and Its physiological 
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Figure 3 presents the results of the first type of simulation stated 
previously. It shows the temperature pro f iles of various elements under 
steady-state condition. The metabolic rates in various el^meets and blood 
flow rates between adjacent elements are assumed to be zero. The results 
indicate that the temperature profile of the arms, legs, and torso are 
nearly straight around 107. 6°F (42.G°C) which is assumed to be the effective 
environmental temperature of these elements. The temperature profile for 
the head is also nearly straight around its effective environmental temperature 
which is assumed to be 77.0°F (25.0°C). The slight deviation of temperature 
profile from its effective environmental temperature is caused by the errors 
due to the finite difference approximation and Simpson's rule of integration. 

The results also show that the model works properly when the metabolic rates 
of all the elements and the blood flow rates between adjacent elements are 
assumed to be zero. 

The purpose of the second type of simulation in which the blood circulation 
between the adjacent elements is considered while the metabolic heat generation 
in all the elements is neglected is to investigate the Interdependence among 
the elements. The cooler effective environmental temperature of t v e head is 
expected to affect the temperature profile of other elements where the effective 
environmental temperatures are higher than that of the head. The temperature 
profiles are also expected to fall within the two bounds: the upper limit of 
107. 6 # F (42.0*C) and the lower limit of 77.0*F (25.0*C) • Figure 4 presents 
the results of this second simulation. It shows the temperature profiles of 
all elements. Because of the direct connection by blood circulation between the 
torso and head* arms, and legs, the temperature profiles among them show only 
a alight different# of about 1*F in temperature at the inner core. This 
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slight difference is caused by the assumption that both the arterial blood 
pool and venous blood pool have a uniform tempera '.ure throughout a given 
element. A difference of about 7 t F can be seen, however, between the temperature 
at the surface of the head and those of the other elements. 

The main reason that the temperature profiles are lower than i07.6°F 
(42.0 # C) which is the effective environmental temperature of the torso, arms, 
and legs is that the effective environmental temperature of the head is ;7.0°F 
(25.0®C). This lower effective environmental temperature is intended to cool 
the blood temperature inside the head. The venous blood flowing out of the 
head, in turn, cools off the blood temperature of the torso, arms, and legs. 
Because the amount of blood distributed to each element is assumed to be 
approximately 20% in the head, 60% in the torso, 8% in the arms and 12% in 
the legs, the steady-state temperatures obtained which are around 105. 8°F 
(41.0°C) can be reasonably expected. 

Some of the most significant temperature profiles of all the elements 
are shown in Figure 5. It presents the results of the third type of simulation. 
Blood circulation between the adjacent elements and metabolic heat generation 
in each element are permitted. The results indicate that the effect of the 
lower effective environmental temperature on the head Is overcomed by its 
high rate of heat generation by metabolic reactions. The same reasoning 
can account for the higher temperature profile of the head than that of the 
arms. The teller at ure profile of the arms is slightly lower than that of 
the legs even though the same metabolic rate is assigned. This is due to the 
fact that the arm has & smaller volume than the leg and is easily affected by 
i«- ' effective environmental temperature. The results also Indicate that the 


<? 


29 


simulated environment is not adequate for a person to stay indefinitely 
because the steady state core temperatures of the elements of the body are 
around 112. 0°F. 

Figure 6 presents the results of a parametric study of the temperature 
at various locations of the body. The core and skin temperatures of the 
head and torso are presented. The results indicate that the temperatures 
increase almost linearly as the metabolism increases. 
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5. DISCUSSION AND CONCLUDING REMARKS 

As mentioned in the previous section, the model presented in this 
report is a modified steady-state version of Wissler's unsteady-state model 
[19] (1964)- The main difference between these two models is in the expres- 
sions of * i'it conduction of the torso and energy balance equations of the 
arterial blood and venous blood in the torso- Wissler [19] (1964) used 
Crank-Nicholson 1 s implicit finite difference technique to approximate the 
unsteady-state system aquations and employed the Gausian elimination method 
to solve a set of interrelated linear algebraic equations for each element. 

The model discussed in this report uses the explicit forward finite difference 
technique to approximate the steady-state system equations and employs the 
elimination method by using the largest pivotal division to solve the 
simultaneous linear algebraic equation for the entire system which considers 
the interdependence of all the elements. 

The technique illustrated in this report also gives rise to great 
flexibility in using different values of local physiological parameters. But 
because of limited information concerning the different rates of heat generation 
by metabolic reaction in various locations of an element, a uniform rate is 
assumed to each element. The variation of local blood flow rates, however, has 
implicitly been taken into consideration by assigning different values of 
thermal conductivities in different layers of the element. 

One of the important results of this simulation is that one can visualize 
the effects of localized cooling (or warming) on the therm a -1 system of the 
human body. The Investigation of these effects will provide valuable information 
as to the feasibility of creating a local microenvironment for those persons 
who are often exposed to the tnstile environment. This study will also be useful 
for devicing ways to protect persons involved in space exploration or underwater 







References 


1. Carslaw, H. S. and J. C. Jaeger, The Conduction of Heat in Solids , 

Oxford University Press, 1959. 

2. Crosbie, R. J., J. D. Hardy and E. Fessenden, in "Temperature - Its 
Measurement and Control in Science and Industry," J. D. Hardy, ed., 

Vol . 3, Pt. 3, pp. 627-635, Reinhold, New York, 1963. 

3. Eichna, L. W. , W. F. Ashe, W. B. Bean and W. B. Shelly, "The Upper 
Limits of Environmental Heat and Humidity Tolerated by Acclimatized 
Men Working in Hot Environment," Jour. Ind. Hyg. Toxical. 27^, 59 
(1945). 

4. Fan, L. T. , F. T. Hsu and C. L. Hwang, "A Review of Mathematical 
Models on the Human Thermal Systems," Report No. 20, Institute for 
Systems Design and Optimization, Kansas State University, 1970. 

5. Forsythe, G. E. and W. R. Wasow, Finite Difference Methods for Partial 
Differential Equations , John Wiley and Sons, N. Y., 1960. 

6. Guyton, A. C., Text Book of Medical Physiology , 3rd Edition, Saunders, 
Philadelphia, 1966. 

7. IBM System/360 Scientific Subroutine Package (360A-CM-03X) , Version III, 
Programme 's Manual. 

8. King, B. G. and M. J. Showers, Human Anatomy and Physiology , 6th Edition, 
Saunders, Philadelphia, 1969. 

9. Konz, S., Private Communications (1969). 

10. Licht, S. , Medical Climatology , The eight volume of Physical Medicine 
Library, Vaverly Press, Baltimore, 1964. 

11. Machle, W. and T. F. Hatch, "Heat: Man's Exchanges and Physiological 

Respcvses," Physio. Rev., £7, 200-227 (1947). 

12. Pannes, H. H., "Analysis of Tissue and Arterial Blood Temperatures in 
the Resting Human Forearm," Jour. Appl. Physiol., 1^, 93-112 (1948) 

4.3. Perry, R. H., C. H. Chilton and S. D. Kirkpatrick, Chemical Engineer's 
Handbook . 4th Edition, McGraw-Hill, N. Y., 1963. 

14. Salvador!, M. G. and M. L. Baron, Numerical Methods in Engineering , 

Jnd Edition, Prentice Hall, N. J., 1961. 

1>. Stolwijk, J. A. J. and D. J. Cunningham, "Expansion of a Mathematical 
Model of Thermoregulation to Include High Metabolic Rates," NAS-9-7140, 
John B. Pierce Foundation, 1969. 



* m*wwi u* 


j 




•ftl 




***•*►»* *-4- • - 


33 


16. Stolwijk, J. A. J. and J. D. Hardy, "Temperature Regulation in Man- 
A Theoretical Study," Pflugers Archiv, 291 , 129-162 (1966). 

17. Wissier, E. H. , "Steady-state Temperature Distribution in Man," 

Journal of Applied Physiology, Vo.t.. 16, No. 4, 1961. 

18. Wissier, E. H., "An Analysis of Factors Affecting Temperature Levels 
in the Nude Man," in Temperature - Its Measurement and Control in 
Science and Industry, Vol. 3, Pt . 3, Remhold, N. Y., 1963. 

19. Wissier, E. H., "A Mathematical Model of the Human Thermal System," 
Bulletin of Mathematical Biophysics, Vol. 26, 1964. 

20. Wyndham, C. H. and A. R. Atkins, "An Approach to the Solution of the 
Human Biothermal Problem with the Aid of an Analog Computer," Proceedings 
of the Third International Conference on Medical Electronics, London, 
1960. 


% 













Radiol distance (% { ) 

Fig. 3. Temperature profile of . steady slate case 
along radial distance. (Blood flow and 
metabolic rates are both zero). 





Body temperature ( °F ) 









VI 







42 


APPENDIX A 

Heat transfer coefficient from the human skin to its environment is 

contributed by four factors; namely, conduction, convection, radiation, 

and evaporation. The magnitude of the effective heat transfer coefficient 

depends very much on the physical properties of the surrounding medium, 

the motion of the medium, the relative humidity of the medium, and the 

wetness of the surface of the skin. Hence, the effective heat transfer 

coefficient , H, can be expressed by 

H = H +H + H (A-l) 

ere 

where 

H = heat transfer coefficient for convection 
c 

H = heat transfer coefficient for radiation 
r 

= heat transfer coefficient for evaporation 

The heat transfer coefficient for conduction is neglected because 
of its small magnitude. The heat transfer coefficient for convection 
can be predicted using the following equation 

^ - 0.26(^)0.6 Aty.J (A _ 2) 

K f v t h 

where 

D ■ diameter of the cylinder 

* thermal conductivity of the medium 
V » velocity with which the fluid approaches the cylinder 
p * fluid density 
li£ * viscosity of the fluid 
0^ • specific heat of the fluid 
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Equation (A-2) is applicable only if the fluid approaches to a single 
cylinder in the direction which is perpendicular to the axis of the 
cylinder. The heat transfer coefficient is proportional to the 0.6 power 
of the velocity and inversely proportional to the 0.4 power of the diameter. 
For a cylinder that is 8 cm in diameter 

H = 1.8 x l(f 4 V 0 ' 6 — j — (A-3) 

cm x sec x L 

where V is measuied in centimeters per second. For a cylinder that is 
26 cm in diameter the corresponding equation is 

H = 0.95 x 10 -5 V 0 ' 6 — , (A-4) 

cm x sec x C 

Equations (A-3) and (A-4) are used to approximate the values of 11^ for the 
arms, lege, torso, and head. 

2 

The value of R increases from 0.000145 cal/cm x sec x °C to 0.0001663 
r 

2 

cal/cm x sec x °C as the temperature changes from 10°C to 40°C. It is 
nearly constant. Hence, the complex geometry of the human body and the 
wide variety of the area for radiant transfer as the posture of the individ- 
ual varies will not effect the value of significantly. 

The heat transfer coefficient for evaporation in the absence of 
sweating is approximated as follows 

H * 0.16 x 10"* — -g- Cal 

e 2 «. 

cm x sec x C 


This approximation is used in this report because in the future study 
of human subject under control the sweating will be minimized. 
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